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Abstract 

This  research  focused  on  the  pre-contract -award  management  actions 
of  small-scale,  design  euid  development  contracts  and  the  relationship  of 
these  actions  to  schedule  performance.  Three  phases  of  the  contractual 
process  were  studied:  the  planning,  specifying,  and  controlling  phases. 
A  sample  of  25  contracts  from  SPOs  at  Wright -Patterson  AFB  was  obtained. 

Data  on  the  variables  were  obtained  directly  from  the  contract 
files  and  from  the  contract -management  database,  AMIS.  Regression 
analysis  techniques  were  used  to  identify  the  pre-contract -award 
management  actions  that  were  related  to  schedule  performance. 

The  ntunber  of  contract  modifications  was  foiind  to  be  the  most 
significant  factor  related  to  schedule  performance.  Pre-contract -award 
management  actions  that  showed  a  significant  relationship  to  schedule 
performance  were  whether  the  contract  was  pre-scheduled,  whether  the 
contract  involved  concurrency,  whether  a  preliminary  WBS  had  been 
developed,  whether  the  contract  utilized  a  Type  A  or  Type  B 
specification,  whether  the  contract  required  the  schedule  information  to 
be  presented  in  network  format,  and  the  number  of  DZDs  specified  in  the 
CDRL.  In  addition  to  the  identification  of  these  actions,  the  study 
revealed  that  the  management  of  schedule  was  not  well  understood  within 


CONTRACTING  FOR  SCHEDULE  PERFORMANCE: 

THE  RELATIONSHIP  BETWEEN  PRE-CONTRACT -AWARD.  MANAGEMENT 
ACTIONS  BY  THE  DoD  AND  THE  RESULTANT  SCHEDULE  PERFORMANCE 

I.  Introduction 

Within  the  DoD,  the  acquisition  of  equipment  is  achieved  by 
specialist  personnel  within  System  Program  Offices  (SPOs) .  The  efforts 
of  these  personnel  are  coordinated  by  the  designated  Program  Mamager  to 
ensure  that  each  acquisition  achieves  the  specified  cost,  schedule,  and 
performance  requirements  (Cavendish  and  Martin,  1987:1).  Of  these  three 
requirements,  only  schedule  performance  will  be  addressed  by  this 
thesis . 

Within  the  DoD,  the  typical'  acquisition  contract  is  characterized 
as  being  "behind  schedule  and  over  budget"  (Christensen,  1993:37).  This 
situation  occiirs  despite  a  rigorous  amd  well-defined  acquisition 
process.  The  question  that  arises  from  this,  and  which  encapsulates  the 
essence  of  this  research  project,  is:  Why  is  "behind  schedule  and  over 
laudget"  the  typical  situation?  This  thesis  addresses  part  of  this 
question,  through  an  analysis  of  the  relationship  between  the  pre¬ 
contract-award  mauiagement  actions  by  the  DoD  auid  the  resultauit  schedule 
performance . 

To  introduce  the  issues  that  result  from  the  preceding  paragraphs, 
this  chapter  will  proceed  through  a  coverage  of  the  following  topics: 

a.  the  project  management  body  of  Icnowledge, 

b.  the  general  issue. 
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the  specific  problem, 

the  investigative  questions, 

the  scope  and  limitations  of  the  research, 

the  definitions  of  terms,  and 

an  overview  of  the  remainder  of  the  thesis. 


e 


The  Project  Management  Institute  (PMI) ,  the  international 
professional  organization  for  project  managers,  has  established  a 
project -management  body  of  knowledge  (PMBOR) .  The  PMI  and  PMBOK  were 
established  to  "improve  the  effectiveness  and  efficiency  of  the 
management  of  [projects]  ..."  (Wideman,  1987:Part  1:1)  As  this  research 
has  the  same  goals  and  falls  within  the  bounds  of  project  management,  it 
is  appropriate  to  locate  this  research  within  the  relevant  area  of  the 
PMBOK.  For  this  purpose,  note  that  the  terms  acquisition  management  and 
project  management  are  considered  to  be  synonymous  (Cavendish  and 
Martin,  1987:1). 

The  PMBOK  divides  the  project  management  field  into  eight  major 
functions,  namely: 

a .  scope  management , 

b.  quality  management, 

c .  time  management , 

d.  cost  management, 

e .  risk  memagement , 

f.  human  resources  nuuiagement, 

g.  contract /procurement  management,  and 
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h.  conmuni cation  and  information  management  (Nunn, 

1987: Part  3:5) . 

MacDonald  states  that  these  functions  are  not  mutually  exclusive  and  7 

exhibit  a  degree  of  interdependence.  He  further  states  that,  with 
respect  to  the  time -management  function,  the  interdependencies  are  small  , 

(MacDonald,  1983:22).  The  time -management  function  subsumes  all  aspects 
associated  with  schedule  management;  hence,  for  the  purposes  of  this 
thesis,  the  individual  management  actions  which  comprise  the  schedule- 
management  function  are  considered  to  be  independent  of  all  other 
management  actions. 

The  msOK  further  divides  the  time-management  f\inction  into  four 
sub- functions,  namely: 

a.  time  planning, 

b.  time  estimating, 

c.  time  schedxiling,  and 

d.  time  control  (MacDonald,  1983:21;  Beck,  1986:56). 

The  focus  of  this  thesis  --  contracting  for  schedule  performance  -- 
impinges  upon  each  of  these  sub- fvinct ions.  Furthermore,  the  tasks 
associated  with  each  sub-function,  as  given  in  the  PMBOK,  define  the 
scope  of  this  research  (Beck,  1987:Part  C:4) . 


General  Issue 

Most  projects  have  a  three-dimensional  goal:  to  accomplish  the 
requisite  work  within  specified  cost,  schedule,  and  performance 
requirements.  The  three  elements  are  not  mutxially  exclusive,  and 
placing  emphasis  on  wy  one  element  is  likely  to  have  a  negative  Impact 
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on  the  other  two  (Nicholas,  1990:9-10).  This  inter-relationship 
cooqplicates  the  management  function:  in  specifying  schedule-mauiagement 
requirements  in  a  Request  For  Proposal  (RFP)  or  contract,  the  relative 
inqportance  of  schedule,  with  respect  to  the  other  two  elements,  needs  to 
be  ascertained.  Furthermore,  the  methods  used  to  specify  the  schedule- 
management  requirements  must  facilitate  the  evaluation  process,  and  the 
resultant  management  and  control  functions.  Moreover,  these  schedule- 
management  requirements  must  be  cost-effective  wd  efficient, 
commensurate  with  the  magnitude,  complexity,  cost,  and  importance  of  the 
specific  acquisition. 

Schedule  overruns  have  the  potential  to  negatively  impact  the 
acquisition  process  in  three  ways,  as  follows: 

a.  Schedule  overruns  typically  lead  to  cost  overruns 
(MacDonald,  1983:20;  Otegui,  1990:42). 

b.  For  acquisitions  where  the  equipment  being  procured  is 
required  by  a  specific  date,  schedule  overruns  ensure  that 
the  user  will  not  receive  the  equipment  as  plaimed. 

c.  Thu  DoO  has  limited  resources;  hence,  schedule  overruns 
ensure  that  the  resources  attached  to  a  particular  project 
are  xuiavailable  for  reallocation,  as  plaumed,  to  other 
projects. 

From  an  overall  DoD  perspective,  the  inpact  of  schedule  overruns  would 
not  be  as  significant  if  a  high  percentage  of  acquisitions  were  to  meet 
their  schedule  goals.  As  stated  earlier,  however,  the  typical  DoD 
acquisition  is  characterized  by  schedule  slippaje.  In  an  interview  with 
LtCol  Ootcher  and  Mr  Witham  from  che  ciource  Selection  Office, 
Aeronautical  Systems  Center,  HPAFB,  LtCol  Ootcher  stated  that  the 
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evaluation  of  schedule  risk  durii^  the  source- selection  process  was 
currently  a  high  priority  within  Air  Force  Materiel  Comraand  (AFMC) . 

This  additional  requireimnt  had  been  incorporated  into  the  sotirce- 
selection  process  because  a  significant  proportion  of  DoO  acquisition 
contracts  were  not  meeting  the  contracted  schedules  (Gotcher  and  Witham, 
1992) . 

Norman  R.  Augustine,  Chairman  of  Martin-Marietta,  developed  a 
number  of  'laws'  related  to  major  systems  developoient  programs,  and 
documented  them  in  his  book,  Augustine's  Laws  (Augustine,  1982) . 
Augustine  performed  an  analysis  on  a  large  number  of  major  system 
development  programs,  euid  was  able  to  identify  trends  with  respect  to 
cost,  schedule,  and  performance.  Law  Number  XXIZ,  which  is 
diagrammatically  explained  in  Figure  1-1,  states:  "Any  task  can  be 
caapleted  in  only  one-third  more  time  than  ia  currently  estimated” 
(Augustine,  1982:115).  The  data  presented  in  Figure  1-1  was  derived 
from  official  schedule  estimates  predicting  when  various  milestones, 
such  as  first  flight,  first  delivery,  etc.,  would  occur.  While  this 
'law'  implies  that  little  can  be  done  to  improve  the  acqpiisition 
process,  the  reasons  underlying  the  Fantasy  Factor  of  1.33  are  not 
forthcoming.  Only  through  a  thorough  and  detailed  analysis  of  the 
significant  number  of  factors  which  could  cause  or  control  schedule 
overruns  will  the  process  be  adile  to  be  inproved.  This  is  the  intent  of 
this  research.  The  information  presented  in  Figure  1-1,  however,  does 
provide  a  clear  picture  of  the  magnitude  of  the  problem. 

Otegul  discusses  potential  reasons  for  cost  growth  in  DoD 
acquisitions  (Otegui,  1990:41) .  Cost  and  schedule,  however,  have  long 
been  recognized  as  correlated  (Garvey  and  Taub,  1992 :i).  As  a 


Accuracy  of  Projoctlng  Accompllsiiinont  Date 
for  Major  Milestones 
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Figure  31  Uke  coat,  the  prediction  of  acheduk  invo/uea  uneertaintlea  and  riaka. 

IVhen  the  time  actu^j/  required  to  compkte  a  taak  la  compared  utUh  the  time  'tuhlch 
had  oiigtnafly  been  projected,  a  quite  predictabk  correction  factor  con  be  empincoffy 
dertued. 

Figure  1-1.  Augustine's  Schedule  Correction  Law 
(Peter,  1993:86) 

consequence  of  this  correlation,  therefore,  the  reasons  given  by  Otegui 
for  cost  growth  are  also  applicable  to- schedule.  These  reasons  Include 
changes  in  "economic,  quantity  [sic],  [...],  engineering,  estimating, 
[...],  and  support  assunqitions  or  events”  (Otegui,  1990:41).  A  number 
of  these  reasons  are  outside  the  control  of  either  the  DoD  or  the 
contractor  (e.g.,  economic  events).  Many  of  the  reasons,  however,  do 
fall  within  the  span  of  control  of  either  the  DoD  or  the  contractor. 

This  inqiliea,  therefore,  that  the  DoD  has  the  ability  to  obtain  inq>roved 
schedule  performance . 


The  Intent  of  this  study  is  not  to  undertake  a  detailed 
investigation  into  the  causes  of  schedule  overruns.  Instead,  this  study 
will  take  it  as  given  that  problems  exist,  and  will  investigate  the 
current  DoO  pre-contract -award  management  actions  to  determine  the 
effect  of  those  actions  on  schedule  performance.  It  is  the  authors' 
belief  that  knowledge  of  the  relative  impact  of  these  actions,  with 
respect  to  schedule  performance,  will  be  of  considerable  use  to  Program 
Maxiagers . 


SpggjLtjLs  Problom 

As  stated  earlier,  there  are  many  factors  with  the  potential  to 
affect  the  contracted  schedule  performance,  some  of  which  are  iinknowable 
at  the  time  of  contract  award.  This  research,  however,  is  only 
concerned  with  those  factors  that  are  either  knotm  or  predictable  prior 
to  contract  award.  By  considering  the  "kno%m"  factors.  Program  Managers 
can  incorporate  the  necessary  management  actions,  to  address  those 
factors,  into  the  contractual  documentation.  Specifically,  this 
research  amalyzes  those  DoD  pre-contract -award  management  actions  which 
are  believed  to  affect  the  contracted  schedule  performance.' 

In  addressing  these  issues,  the  contractual  process  cam  be  divided 
into  the  following  four  activity  areas; 

a.  planning  the  acquisition, 

b.  specifying  the  requirement, 

c.  evaluating  the  proposals,  and 

d.  monitoring  and  controlling  the  resultant  contract. 


Nhlle  the  last  of  these  foiir  activities  is  not  a  pre-contract -award 
action,  the  ability  to  effectively  and  efficiently  monitor  and  control  a 
contract  is  highly  dependent  upon  consideration  of  the  relevant  issues 
during  the  planning,  specifying,  and  evaluating  phases. 

Bach  of  the  four  activity  areas  involves  specific  management 

actions  idiich  have  the  potential  to  affect  schedule  performance.  The 

first  step  in  this  research,  therefore,  is  to  identify  those  actions 

which  may  affect  schedvile  performance.  Secondly,  those  actions  need  to 

be  analyzed  to  determine  vdiich  actions  are  (and  are  not)  related  to 

schedule  performance.  Thirdly,  the  effect  on  schedule  performance,  of 

those  actions  which  demonstrate  a  relationship,  needs  to  be  quantified 

(i.e.,  the  magnitude,  and  whether  positive  or  negative).  Finally,  it  is 

» 

necessary  to  determine  which  actions,  of  those  which  have  a  positive 
relationship  with  schedule  performance,  can  be  itqplemented  in  a  cost- 
effective  and  efficient  maumer. 

Investigative  Questions 

To  address  the  specific  problem,  a  series  of  investigative 
questions  were  developed,  and  these  are  listed  below: 

a.  Which  mamagement  actions,  with  the  potential  to  affect 
schedule  performauice,  may  occnir  prior  to  contract  award? 

b.  Which  DoD  mamagement  actions,  during  the  planning  phase, 
influence  schedule  performauice? 

c.  Which  DoD  mamagement  actions,  during  the  specif ication-of- 
requirements  phase,  influence  schedule  performance? 
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d.  Which  DoD  numagement  actions,  during  the  evaluation  phase, 
influence  schedule  performance? 

e.  Of  the  OoD  management  actions  which  positively  influence 
schedule  performance,  which  can  be  cost-effectively 
implemented  (commensurate  with  the  selected  project 
characteristics) ? 

Scone  and  Limitations 

The  DoO  acquisition  and  contracting  processes  enconpass  a 
significamt  number  of  interrelated  sub-processes.  To  ensure  that  a 
research  proposal  is  executable,  only  a  small  portion  of  related  sub¬ 
processes  can  be  effectively  studied  within  the  allotted  time- frame. 

From  the  outset,  the  scope  of  this  research  has  been  limited  to 
schedule -management  issues.  A  number  of  other  aspects  further  limit  the 
scope  of  the  research.  To  address  these  issues,  this  section  will 
discuss : 

a.  the  scope  of  the  research, 

b.  sanple  limitations, 

c.  data  limitations,  and 

d.  possible  confounds. 

Scone  of  the  Research 

The  management  of  schedule  performance,  throughout  the  contractual 
process,  involves  a  relationship  between  the  DoD  amd  the  contractor. 

This  relationship  is  defined  by  four  groups  of  factors,  specifically: 
a.  those  vmder  the  control  of  the  DoD, 


b. 


those  under  the  control  of  the  contractor. 


c.  those  associated  with  the  relationship  between  the  two,  emd 

d.  those  outside  the  control  of  either  (CPG  No  8  (draft) , 

1992) . 

The  latter  t%fo  groups  of  factors  (which,  in  the  first  instance,  includes 
the  face-to-face  interaction  betvreen  OoD  and  contractor  personnel,  and, 
in  the  second  instance,  includes  Congressional  influence,  changes  in 
requirement,  and  force  majeure  factors)  are  essentially  post- contract - 
award  factors,  and  are  outside  the  scope  of  this  research.  On  the  other 
lumd,  the  first  t%ra  groups  of  factors  are  controllad>le  in  a  rigorous  and 
defined  manner  (e.g.,  through  directives,  instructions,  amd  guidance 
documents  in  the  first  instance,  and  through  the  contractual  process  in 
the  second) .  A  study  of  these  two  groups  of  factors,  in  an  attempt  to 
improve  the  effectiveness  and  efficiency  of  schedule  mauiagement , 
therefore,  is  a  worthwhile  endeavor. 

Limitations  with  the  Sample 

The  population  of  interest  for  this  research  is  defined  as:  all 
DoD  acquisition  contracts  which  meet  the  requisite  project 
characteristics.  (Note,  Chapter  III  specifies  which  project 
characteristics  define  the  population.)  The  sample  frame,  which  has 
been  selected  for  economic  reasons,  is  defined  as:  USAF  acquisition 
contracts  at  NPAFB  within  approximately  the  last  fifteen  years.  This 
sample  frame  is  believed  to  be  representative  of  DoD  acquisition¬ 
contracting  practices  for  the  following  reasons: 

a.  WPAFB  is  the  major  acquisition  center  within  the  USAF, 
especially  for  the  population  of  interest.  This  sample 


frame,  therefore,  is  representative  of  USAF  acquisition¬ 
contracting  practices. 

b.  The  major  acquisition  directives  and  instructions  (e.g.,  the 
Federal  Acquisition  Regiilations  (FAR) ,  the  DoD  5000  series 
of  acquisition  directives,  and  the  MIL-STDs  referenced  by 
the  5000  series)  are  multi-service  doctunents.  Furthermore, 
OoD  Directive  5000.1,  Defense  Acquisition,  and  DoD 
Instruction  5000.2,  Defense  Acquisition  Management  Policies 
and  Procedures,  contain  specific  instructions  that  prohibit 
supplementation  of  the  requirements  mandated  therein  (DoD 
Directive  5000.1,  1991:3;  DoD  Instruction  5000.2,  1991:4)  . 
The  mandated  requirements,  therefore,  are  common  to  all 
services . 

Limitations  with  the  Data 

A  number  of  limitations  with  the  data  are  evident  for  this  thesis, 
and  these  limitations  can  be  broken  down  into  two  areas: 

a.  limitations  stemming  from  the  data  type,  euid 

b.  limitations  stemming  from  san^ling  concerns. 

Limitations  Stemming  from  the  Data  Type.  The  primary  concern  with 
the  data  type  is  that  the  available  data  reflects  the  end-product  of  a 
considereQ>le  number  of  ho\irs  spent  plauming,  discussing,  arguing,  euid 
assimilating  feedback.  The  availadile  data  are  "hard"  data  amd  do  not 
reflect  the  reasons  underlying  the  selection  process.  There  is  little 
visibility  into  the  situational  factors  prevalent  at  the  time  that  the 
acquisition  documents  were  created.  The  effect  of  this  aspect  on  the 
research  is  that  there  is  virtvially  no  cUoility  to  allow  for  variances 


due  to  situational  factors  (e.g..  posited  schedule  optimism  as  a  result 
of  political  considerations) . 

Limitations  Stemming  from  Sampling  Concerns.  Due  to  the  unique 
nature  of  this  research,  a  suitable  database  does  not  exist  from  which 
the  requisite  data  can  be  extracted;  hence,  the  data  must  be  obtained 
directly  from  the  available  contract  files.  This  mode  of  data 
collection  is  extremely  time-consuming  and  impacts  upon  the  ability  to 
obtain  a  statistically-signific2mt  san^le  size.  Furthermore,  the 
ability  to  obtain  a  meaningful  sample  size  was  further  impacted  by  the 
availability  of  the  requisite  contractual  documentation  (i.e.,  documents 
may  be  incomplete,  missing,  or  classified) . 

Problems  with  Confounds 

Many  factors  have  the  potential  to  confound  the  measurement  of 
schedule  performance.  For  example,  the  interactive  nature  of  the  three 
acquisition  goals  --  cost,  schedule,  cuid  performcuice  --  can  rtuUce  it 
difficult  to  isolate  the  impact  of  management  actions  on  schedule. 
Furthermore,  there  are  many  post-contract-award  mcuiagement  actions  and 
considerations  (e.g.,  changes  in  technical  requirements,  politics, 
competence  of  the  Program  Manager,  and  cohesion  of  the  acquisition  team 
within  the  SPO)  which  could  impact  schedule  performance.  These 
confounds  will  need  to  be  considered  to  ensure  that  the  effects  of  the 
pre-contract -award  management  actions  are  satisfactorily  isolated. 
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Definitions  of  Terma 


The  only  term  which  requires  a  definition  is  schedule  perf ormeuice , 
which  is  defined  as  the  relationship  between  the  planned  (i.e., 
contracted)  performance  period  amd  the  actual  performance  period. 

A  list  of  acronyms  used  throughout  this  thesis  is  given  at 
Appendix  A. 


Overview  of  the  Thesis 

Chapter  II  of  the  thesis  will  discuss  current  research  relevant  to 
this  thesis,  and  will  discuss  the  DoD  contractual  process  from  the 
perspective  of  schedule  management.  Chapter  III  will  utilize  the 
overview  of  the  contractual  process  provided  in  Chapter  TI  as  the  )>asis 
for  determining  the  data-collection  requirements  euid  plan.  Furthermore, 
Chapter  III  will  detail  the  statistical  tests  that  were  used  to  answer 
the  investigative  questions.  Chapter  IV  will  present  the  data  emalysis 
cuid  the  results  from  that  analysis.  Finally,  Chapter  V  will  present  the 
conclusions  and  recommendations,  emd  will  identify  topics  for  future 
research. 


Chapter  Summary 

This  chapter  introduced  the  subject  area  for  this  research:  the 
relationship  between  pre-contract-award  numagement  actions  by  the  DoD 
and  the  resulteuit  schedule  performance.  To  this  end,  the  need  for 
adequate  schedule  performance  was  first  estadslished  and  some  of  the 
reasons  for  schedule  overiruns  were  provided.  Following  this,  the 


specific  research  problem  and  associated  investigative  questions  were 
presented.  In  addition,  the  scope  of,  and  limitations  with,  the 
research  were  discussed.  Finally,  an  overview  of  the  remainder  of  the 


thesis  was  provided. 


This  literature  review  will  describe  current  research  that 
specifically  relates  to  the  authors'  area  of  interest:  characterizing 
the  relationship  between  pre-contract -award  management  actions  by  the 
DoO  and  the  resultant  schedule  performance.  Ftirthermore ,  the  literature 
review  will  provide  an  understanding  of  the  factors  which  affect 
schedule  performance  throughout  the  contracting  process,  as  well  as  w 
appreciation  of  the  opportunities  for  improving  schedule  performance. 

The  facets  of  schedule  management,  which  were  introduced  in  the 
preceding  paragraph,  will  be  explored  further  in  the  literature  review, 
through  a  coverage  of: 

a.  the  history  of  schedule-management  techniques  within  the 
DoO, 

b.  current  research  in  the  area  of  schedule -perfornumce 
achievement , 

c.  existing  studies  concerning  schedule  performance  for  DoD 
acquisitions, 

d.  factors  \inder  the  control  of  the  DoD  which  have  the 
potential  to  affect  schedule  perfornumce, 

e.  factors  under  the  control  of  the  contractor  which  have  the 
potential  to  affect  schedule  performance,  and 

f .  a  siumnary  of  the  chapter. 

The  history  of  schedule-management  techniques  is  an  appropriate  starting 
point  to  set  the  stage  for  the  current  research  in  the  area. 


History  of  Schedule-Management  Techniques  within  the  DoD 

During  World  War  I,  Henry  Laurence  Oeuitt  developed  what  became 
known  as  the  Oantt  (or  bar)  chart  (Fleming,  1988:15) .  Gantt  charts  are 
simple  graphical  representations  of  project  tasks  on  a  horizontal  time- 
scale.  Progress  is  syndaolized  by  the  filling  in  of  the  hollow  bar 
(Fleming,  1988:15) .  A  vertical  'time  now'  line  is  drawn  on  the  chart  to 
assess  current  progress,  indicating  whether  individual  tasks  are  adiead 
of,  or  behind,  schedule  (Fleming,  1988:15).  Gantt  charts  are  limited  in 
that  "they  do  not  esqilicitly  show  the  relationships  aunong  tasks  nor  the 
impact  of  delaying  activities  or  shifting  resources"  (Nicholas, 
1990:270).  Despite  their  limitations,  Gantt  charts  are  used  widely 
throughout  industry  today  because  of  their  simplicity.  An  example  of  a 
Gantt  chart  is  given  in  Figure  2-1. 

The  earliest  significant  project  control  system  enployed  by  the 
DoD,  post  World  War  I,  amounted  simply  to  the  reporting  of  project 
progress  auid  status  by  the  contractor  (Fleming,  1988 :xii) .  The 
reporting  requirements  were  foreign  to  the  contractors'  management 
control  systems,  however,  which  made  an  unwelcome  orphan  of  the 
government  requirements  (Fleming,  1988 :xii).  This  project  control 
system  resulted  in  the  reported  information  being  regarded  as  inadequate 
and  untimely,  precluding  effective  proactive  management  action  (Fleming, 
1988 :xii) .  The  actual  status  of  the  project,  in  terms  of  the  true  cost 
for  the  work  performed  (termed  'earned  value, '  which  will  be  discussed 
later)  was  not  apparent  and  the  reported  information  provided  little 
assurauice  that  the  project  was  within  cost  and  schedule  (Fleming, 

1988 :xii).  Thus,  the  stage  was  set  for  inprovement,  as  the  DoD  was 
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embarking  on  many  new  high-value  state-of-the-art  projects  that  could 
not  afford  to  incvir  cost  and  schedule  overruns. 


Figure  2-1.  Bxan^le  of  a  Gantt  Chart  (Nicholas,  1990:258) 


In  the  late  1950s  and  early  1960s,  the  Prograun  Evaluation  amd 
Review  Technique  (PERT)  came  to  the  forefront  through  application  in  US 
Navy  programs  (Sleouker,  1985:6).  PERT  is  a  network-based  technique 
that  "cleaurly  show[sl  interdependencies  aunong  activities  and  enaUbleEs] 
plamnlng  amd  schedulihg  functions  to  be  performed  separately"  (Nicholas, 
1990:270)  .  With  PERT,  mamagers  were  aUt>le  to  effectively  plam  each 
project  through  their  understamding  of  how  the  project  would  be  executed 
(Fleming,  1988:18;  SlemaUcer,  1985:6).  The  basic  PERT  evolved  into  a 
number  of  offspring  (although  the  basics  of  the  technique  remained) , 
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notably  the  Critical  Path  Method  (CVH) ,  the  Precedence  Diagram  Method 
(POM) ,  the  Graphical  Bvalviation  and  Review  Technique  (GERT) ,  axid  the 
PBRT/Coet  method  (Fleming,  1988:18-19;  Slemaker,  1985:6).  Figure  2-2 
illustrates  the  PERT  net«for)c  technique  for  defining  a  project.  (KOte, 
for  detailed  descriptions  of  these  techniques,  refer  to  any  project - 
management  text,  e.g.,  Nicholas,  1990.)  Although  the  capability  to 
effectively  plan  a  coi(q>lex  project  was  satisfied  by  PERT,  there  still 
remained  the  difficulty  of  relating  the  budgeted  cost  of  wor)c  performed 
to  the  budgeted  cost  of  woric  scheduled  (Slemalcer,  1985:6-7). 
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Figure  2-2.  Example  of  a  PERT  Networlc  (Nicliolas,  1990:292) 


As  highlighted  by  the  preceding  paragraph,  lay  the  mid  1960s,  the 
DoO  had  a  number  of  different  management  control  systems  in  use,  which 
resulted  in  a  lacic  of  standardization  in  project -management  approaches. 
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In  an  attenpt  to  standardize,  the  DoD  introduced  the  Cost/Schedvile 
Control  Systems  Criteria  (C/SCSC) .  As  evidenced  from  the  name,  C/SCSC 
is  a  set  of  criteria  idiich  provides  the  basis  for  determining  the 
acceptability  of  a  contractor's  cost  and  schedule  management  control 
systMB  (Orskovich,  1990:26) .  C/SCSC,  therefore,  is  a  philosophy  rather 
than  a  system  (Slaaudcer,  1985:7;  Fleming,  1988:25).  Nhen  combined  with 
the  specified  reporting  requirements  (Cost  Performance  Reports  (CPRs) ) , 
the  criteria  provide  an  effective  management  tool  for  use  by  the  Doo 
(Grskovich,  1990:31).  C/SCSC  is  an  'earned  value'  approach  to 
management,  in  that  the  contractor's  management  control  system  keeps 
track  of  funds  expended,  as  well  as  the  percentage  of  work  completed 
(Nicholas,  1990:28) .  The  DoD  also  uses  another  earned  value  approach: 
the  Cost/Schedule  Status  Report  (C/SSR) .  The  C/SSR  approach  enploys  the 
same  cost  and  schedule  measxirement  techni(|ues  as  C/SCSC;  however,  it  is 
used  for  lower  cost  acquisitions  and  the  reporting  is  less  stringent 
(C/SSR  Joint  Guide,  1978:Ch  1,  4-5). 

This  brief  history  reveals  the  main  cost-  and  schedule-management 
techniques  available  to  the  DoD:  Gantt  charts,  network  diagrams,  C/SSR, 
and  C/SCSC  and  CPR.  These  techniques  mainly  apply  to  the  monitoring  amd 
control  phase  of  the  contractual  process.  The  next  section  will 
continue  the  progressive  development  of  schedule-management  techniques, 
introduced  in  this  section,  through  a-  discussion  of  the  current  research 
in  the  area.  Specifically,  the  relationship  between  project 
characteristics  and  the  selection  of  project -management  techniques,  amd 
the  relationship  ]E>etween  project  Inputs  amd  project  outcomes  will  be 


addressed. 


Current  Research 


> 


r 


Little  research  has  been  conducted  in  the  area  of  schedule 
performance.  There  is  considerable  information  concerning  the  project 
characteristics  that  should  be  considered  when  addressing  the  management 
of  projects;  however,  the  relationships  bettieen  these  characteristics 
and  schedule  performance  have  received  little  attention.  Furthermore, 
the  relationship  betmen  management  actions  ^md  schedule  performance  has 
not  been  addressed.  This  section  will  present  a  brief  overview  of  the 
ctirrent  research  related  to  schedule  management  and  schedule 
performance . 

Project  Characteristics 

Schedule-management  techniques  should  be  selected  for  a  particular 
project  based  upon  the  specific  characteristics  of  that  project.  In 
addition,  the  project  characteristics  define  tdiich  schedule -management 
technic[ues  can  be  cost-effectively  and  efficiently  inqplemented.  To 
obtain  a  better  appreciation  of  this  perspective,  a  discussion  of 
project  characteristics  is  required. 

A  review  of  the  project -management  literature  provided  the 
following  list  of  characteristics  which  were  considered  to  be  of 
particular  relevance  when  addressing  the  maxiagement  of  projects: 

a.  expected  cost  (i.e.,  total,  auid  of  significant  sub¬ 
elements)  ; 

b.  perceived  conplexity  (e.g.,  number  of  elements  in  the  worlc 
breaOcdown  structure  (WBS) ) ; 

c .  e]q>ected  duration; 
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d. 


project  type  (e.g.,  research  and  development,  limited  design 


and  development,  systems  integration,  etc) ; 

e.  degree  of  uncertainty; 

f.  planned  amount  of  concurrent  activity; 

g.  planned  amount  of  conqpetition  (e.g.,  sole  source  or 
competitively  bid) ; 

h.  planned  contract  type  (e.g.,  fixed  price  or  cost  plius) ; 

i.  pricing  arrangement  (e.g.,  incentives  and  award  fees) ; 

j.  System  Program  Office  (SPO)  organization  (i.e.,  matrix  or 
pure  project) ; 

k.  resource  limitations  in  the  SPO; 

l.  perceived  number  of  stakeholders;  and 

m.  expected  amount  of  intervention  from  higher  authorities 
(e.g.,  Congress)  (Bubshait  and  Selen,  1992:43;  Slevin  and 
Pinto,  1986:57-61;  Nicholas,  1990:465-471;  Cleland, 
1986:36)  . 

An  assessment  of  each  of  these  characteristics  is  needed  for  each  DoD 
contract  to  determine  the  appropriate  methods  for  specifying  schedule- 
management  requirements  in  the  RFP  or  contract,  such  that  the  desired 
schedule  performance  is  achieved. 


In  deciding  which  schedule -management  approach  to  utilize  in 

differing  sitiiations,  project -management  texts  provide  little  guidance. 

Bubshait  and  Selen,  in  their  paper  on  this  subject,  state: 

Largely  absent  in  project  management  research  are  studies  of  the 
relationship  between  specific  project  characteristics 
(lincertainty,  coiiq>lexlty,  high  indirect  costs,  duration,  etc)  2md 


the  application  of  project  management  techniques.  (Bubshait  and 
Selen,  1992:43) 

The  need  for  such  a  study  was  recognized  by  Webster  in  1982 :  "There  is 
criticism  of  project  management  literature  in  regard  to  the  inability  to 
find  guiduce  as  to  which  tool  and  which  variant  to  use  under  what 
circumstances"  (Webster,  1982:13). 

Project  Incuts  and  Schedule-Performance  Outcomes 

A  third  paper  by  Merrow  and  Yarossi  discusses  the  need  for  the 

specific  research  being  undertaken: 

[ . . . ]  we  want  to  identify  as  many  of  the  possible  variables  that 
could  affect  project  performance  as  possible.  [...}  we  need  to 
analyze  project  performance  to  evaluate  how  the  project  inputs 
influence  project  outcomes.  (Merrow  auid  Yarossi,  1990 :H. 6. 3) 

Merrow  and  Yarossi  collected  data  on  2000  variaLbles  from  44  projects 

within  the  oil,  chemical,  and  minerals  industries.  Using  this  data, 

regression  analysis  was  conducted,  in  the  first  instance,  to  derive  a 

relationship  between  project  characteristics  and  cost-estimate 

deviation.  Following  this,  "similar  models  [were]  developed  for  project 

schedule,  startup,  and  operational  performance"  (Merrow  and  Yarossi, 

1990:H.6.5) . 

These  three  research  exaiiq>les  encapsulate  the  essence  of  this 
research:  for  DoD  acquisitions,  what  is  the  effect  of  the  pre-contract- 
award  management  actions  taken  lay  the  DoD  on  the  contracted  schedule 
performance?  To  place  this  research  in  context,  2m  overview  is  required 
of  the  studies  that  have  been  conducted  with  respect  to  schedule 
performance  within  the  DoD.  A  discussion  of  three  studies  is  presented 


Late  in  the  thesis  process,  three  studies  were  discovered  which 
concerned  DoD  acquisition  schedules.  These  studies  were  all  conducted 
by  the  Rand  Corporation  at  approximately  ten  year  intervals.  These 
studies  encapsulate  the  major  emphases  that  have  been  utilized  to 
analyze  OoD  acquisition  schedules.  The  three  studies  are: 

a.  System  Acquisition  Strategies  (Perry  et  al,  1971) ; 

b.  An  Analysis  of  Weapon  System  Acquisition  Schedules.  Past  and 
Present  (Smith  and  Friedmann,  1980) ;  amd 

c.  An  Analysis  of  Weapon  System  Acquisition  Schedules  (Drezner 
and  Smith,  1990) . 

This  section  will  present  a  brief  overview  of  each  of  the  studies,  the 
significant  and  relevant  finr^ings,  and  how  the  three  studies  differ  from 
the  research  being  undertaken  through  this  thesis  effort. 

Overview  of  the  1971  study 

The  1971  study  was  mainly  concerned  with  identifying  acquisition 
policies  amd  strategies  that  contributed  to  program  growth  --  cost, 
schedule,  and  performance  --  and  to  propose  improved  procedvires  for 
estimating  program  outcomes  (Perry  et  al,  1971:1) .  This  study  collected 
cost,  schedule,  auid  performance  data  for  24  major  systems.  The  results,' 
with  respect  to  schedule  only,  are  presented  in  Figure  2-3,  which  shows 
an  average  schedule  overrun  of  approximately  15%,  with  a  range  of 
performance  from  0.5  to  2.5  times  the  plaumed  schedule.  One  of  the  main 
concltisions  that  was  drawn  from  their  amalysis  was  that  cost  increases 

ir 

seemed  to  have  been  accepted  in  order  to  meet  performance  eund  schedule 
goals  (Perry  et  al,  1971:9) .  Furthermore,  from  their  data,  the  authors 
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Figure  2-3.  Schedule  Performance:  1971  study  (Perry  et  al,  1971:8) 

concluded  that  two  main  elements  were  responsible  for  the  majority  of 
the  schedule  growth:  technical  \mcertainty,  and  scope  changes  after  the 
start  of  the  weapon  system  development  (Perry  et  al,  1971:16).  Finally, 
the  authors  recommended  that  two  specific  acquisition  strategies  be 
adopted  to  reduce  the  likelihood  of  prograun  growth:  firstly,  that 
acquisition  programs  be  conducted  in  discrete  phases;  amd  secondly,  that 
the  number  of  resources  applied  to  a  program  be  constrained  early  on  in 
the  development  process  to  prevent  work  being  conducted  that  was  not 
relevant  at  that  stage  (Perry  et  al,  1971:41-47) . 

Overview  af  the  1980  Study 

The  thrust  of  the  1980  study  was  to  identify  whether  the 
acquisition  cycle  had  lengthened  over  the  preceding  few  decades,  whether 
any  changes  in  the  length  of  the  cycle  were  due  to  changes  in 
organization  or  procedures,  and  vAiether  there  were  any  practical  ways  to 
reduce  the  length  of  the  acquisition  cycle  without  undesirably  altering 
program  outcomes  (Smith  and  Friedmazm,  198 0:v).  This  study  was  the 


least  relevamt  of  the  three  reviewed  in  this  thesis;  however,  one 
interesting  conclusion  was  that  the  "time  from  beginning  of  full-scale 
development  to  first  flight  has  remained  remarkably  constant  over  a 
period  of  three  decades*  (Smith  and  Friednuuin,  1980 :v) . 

Overview  of  the  1990  Study 

The  1990  study  was  the  most  relevant  of  the  three  in  terms  of  the 

this  thesis  effort.  The  objectives  of  the  study  were  to: 

[ . . .  improve  the]  understanding  of  the  issues  associated  with 
measuring  acquisition  schedules,  evaluating  trends  in  program 
duration,  and  identifying  the  factors  affecting  that  duration. 

The  overall  goal  was  to  provide  suggestions  on  how  to  shorten  the 
time  required  to  complete  weapons  acquisition  programs.  (Drezner 
and  Smith,  1990:1-2) 

Drezner  and  Smith  identified  sixteen  factors  which  were  believed, 
a  priori,  to  have  the  potential  to  affect  the  original  plam  or  to  cause 
deviations  to  the  program  once  underway,  or  both.  These  factors  were: 

a.  competition, 

b.  concurrency, 

c.  fvinding  adequacy, 

d.  prototype  phase, 

e.  separate  contracting, 

f .  Service  priority, 

g .  external  guidance , 

h.  joint  management, 

i.  program  complexity, 

j .  technical  difficulty, 

k.  concept  stedaility, 

l.  contractor  performance, 

m.  exteinoal  event. 


n.  fiindlng  stability, 

o.  major  requirements  stability,  £uid 

» 

p.  program  manager  tiumover  (Drezner  and  Smith,  1990:21-24) . 

The  authors  conducted  a  non-statistical  case-study  anal /sis  of  ten 

^  major  prograuBS  to  determine  the  extent  that  the  preceding  factors 

affected  schedule  performance.  The  case-study  approach  was  chosen  for 
two  reasons:  firstly,  the  original  schedule  plans  do  not  contain 
justification  for  the  proposed  schedule;  and  secondly,  there  are  a  great 
many  factors  that  can  be  expected  to  affect  a  programs  duration,  whereas 
the  sample  size  is  typically  small  (Drezner  and  Smith,  1990:20-21) . 

For  their  model,  Drezner  and  Smith  used  the  following 
characterization  of  program  duration: 

Actual  Program  Length  ^  Length  of  Plan  +  Deviation  from  Plan 

On  average;  the  programs  in  their  sample  incurred  a  schedule  slip  equal 
to  33%  of  the  length  of  the  original  pleuis  (Drezner  and  Smith,  1990:44)  . 
This  number  agrees  with  Augustine's  Femtasy  Factor,  as  discussed  in 
Chapter  I-  Drezner  and  Smith  also  concluded  that  four  factors  accounted 
for  the  largest  portion  of  schedule  slip  for  the  ten  programs  examined: 
external  guidance,  technical  difficulty,  fwding  stability,  and  external 
events  (Drezner  auid  Smith,  1990:vi-vii) .  Three  of  these  are  external 
factors,  with  only  one  --  technical  difficulty  --  being  xmder  the 
•  control  of  the  Program  Manager. 
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There  are  a  consideraUsle  number  of  differences  between  the  three 
studies  discussed  euid  the  research  being  undertaken  for  this  thesis  « 

effort: 

a.  The  three  studies  focussed  on  the  overall  acquisition  ^ 

process  with  respect  to  the  prograun  schedule.  This 

research,  on  the  other  hand,  focusses  on  contractual 
performance  within  the  BMD  phase  of  the  acquisition  cycle. 

b.  The  first  and  third  studies  investigated  the  differences 
between  the  target  schedule  (i.e.,  before  any  contracts  are 
awarded)  and  the  actual  sch.^dule,  whereas  this  research 
investigates  the  differences  between  the  contracted  schedule 
and  the  actual  schedule. 

c.  The  three  studies  investigated  major  programs  from  all  three 
Services,  whereas  this  research  investigates  smaller-scale 
programs  (i.e.,  below  the  C/SCSC  threshold)  from  the  USAF 
only. 

d.  The  three  studies  investigated  schedule  performance  from  the 
perspective  of  the  influence  of  external  factors  and  program 
characteristics.  This  research  investigates  schedule 
performance  from  the  perspective  of  the  influence  of 
management  actions,  specifically,  pre-contract -award 
management  actions . 

m 

e.  Generally,  the  three  studies  did  not  have  sufficient  data  or 
sample  size  to  perform  statistical  analyses;  hence,  the 

M 

results  presented  were  qualitative  in  nature.  This  research 
investigates  the  efficacy  of  pre-contract -award  management 
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actions  by  the  DoO  through  the  use  of  the  appropriate 
statistical  analysesi 

The  overview  of  the  three  studies  presented  here  demonstrates  the 
timeliness  and  importance  of  the  current  research.  The  inter¬ 
relationship  between  pre-contract -award  management  actions  auid  the 
resultamt  schedule  performance  has  not  been  investigated.  The  need  for 
this  research,  therefore,  is  readily  apparent. 

To  gain  a  fuller  appreciation  of  the  total  contractual  process,  as 
it  relates  to  schedule  management,  the  factors  under  the  control  of  both 
the  DoD  and  the  contractor  must  be  considered.  The  factors  under  the 
control  of  the  DoD  will  be  discussed  first. 


Factors  Uhder  the  Control  of  the  DoD 

Introduction 

within  the  DoD,  a  number  of  policy  directives,  instructions,  and 
meuiuals  dictate  euid  restrict  the  actions  availed)le  to  the  SPO  throughout 
the  acquisition  life-cycle.  The  major  documents  involved  include: 

a.  the  Office  of  Management  and  Budget  (0MB)  Circular  A- 109, 
Major  System  Acquisitions; 

b.  the  Federal  Acquisition  Regulations  (FAR) ; 

c.  the  DoD  FAR  Supplement  (DFARS) ; 

d.  the  Service  FAR  Supplements  (e.g..  Air  Force  FAR  Supplement 
(AFFARS) ) ; 

e.  DoD  Directive  5000.1,  Defense  Acquisition; 

f.  DoD  Instruction  5000.2,  Defense  Acquisition  Management 
Policies  and  Procedures;  and 
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DoD  Manual  S000.2-M.  Defense  Acouisition  Management 


Documentation  and  Reports. 

0MB  Circular  A-109  provides  broad  policy  guidance  for  major  system 
acqpiisitions .  The  FAR  and  associated  Defense  stq;>plements  provide  the 
regulations  with  respect  to  contract  management.  The  5000  series 
provides  specific  instructions  and  procedures  for  DoD  acquisitions. 

The  DoD  acquisition  process  con^rises  five  phases: 

a.  Phase  0:  Concept  Exploration  auxd  Demonstration; 

b.  Phase  I:  Demonstration  and  Validation; 

c .  Phase  II :  Engineering  and  Manufacturing  Development ; 

d.  Phase  III:  Production  and  Deployment;  and 

e 

e.  Phase  IV:  Operations  and  Support  (DoD  Instruction  5000.2, 
1991:2-1) . 

As  detailed  in  Chapter  I,  the  project  types  of  interest  are  those  that 
include  design  (or  systems  integration)  amd  developmctnt .  As  these  types 
of  projects  are  found  mainly  in  Phase  II  of  the  acquisition  process,  the 
following  discussion  will  be  limited  to  contracts  in  that  phase. 

The  DoD  contracting  process,  for  design  auid  development  contracts, 
can  be  divided  into  the  following  four  activity  areas : 

a.  planning  the  acquisition, 

b.  specifying  the  requirement, 

c.  evaluating  the  proposals,  auid 

d.  monitoring  and  controlling  the  resultant  contract  (Cavendish 

and  Martin,  1987:16) . 

Each  of  these  activity  areas  involves  specific  nuuiagement  actions. 
Furthermore,  the  effectiveness  of  each  successive  activity  is  dependent 
upon  how  well  the  preceding  activity  was  done.  Within  the  DoD,  many  of 


the  actions  required  for  each  of  these  activity  areas  are  conqpletely 
defined.  In  this  section  of  the  literature  review,  each  of  these 
activity  areas  will  be  examined  from  a  schedule -performance  perspective. 
Furthermore,  the  inqpact  on  schedule  management  amd  the  potential  impact 
on  schedule  performance  of  the  documents  listed  in  the  preceding 
paragraph,  and  other  military  standards,  will  be  addressed.  The 
management  act  ons  identified  in  this  section  of  the  literature  review 
were  used  to  generate  the  candidate  variable  list  discussed  in 
Chapter  III. 

Planning  the  Acquisition 

Adequate  planning  of  each  acquisition  is  fundamental  to  a 
successful  project  outcome  (Pinto  and  Slevin,  1988:67;  Thamhain  & 
Hilemon,  1986:79;  Nicholas,  1990:476).  Within  the  DoD,  the  requisite 
management  actions  during  the  planning  phase  are  contained  in  DoD 
Instruction  5000.2.  With  respect  to  schedule  performance.  Sections  A 
and  B  of  Part  5,  Acquisition  Planning  amd  Risk  Mamagement,  auid  Sections 
A  amd  B  of  Part  6,  Engineering  amd  Manufacture,  are  relevauit.  The 
considerations  presented  in  the  following  paragraphs  are  usually 
documented  in  the  Acc[uisition  Plam  (AP) ,  which  is  a  high-level  document 
used  to  ensure  the  effective  integration  of  the  acquisition  events, 
documents,  auid  activities  required  to  satisfy  the  user's  needs  (ASC/CYX, 
1992:24) . 

Acquisition  Strategy.  Section  A  of  Part  5  of  DoD  Instruction 

5000.2  relates  to  acquisition  strategy.  As  stated  in  that  document: 

A  primary  goal  in  developing  aui  acquisition  strategy  is  to 
minimize  the  time  and  cost  of  satisfying  an  identified,  validated 
need  consistent  with  common  sense,  sound  business  practices,  emd 


the  basic  policies  estadilished  by  DoO  Directive  SOOO.l,  "Defense 

Acquisition".  (DoD  Instruction  5000.2,  1991:5-A-1) 

During  the  development  of  the  acquisition  strategy,  consideration  is 
given  to  a  number  of  factors  that  have  the  potential  to  iiiq>act  schedule 
performance,  as  follows: 

a.  Consideration  is  given  to  streamlining  the  acc[uisition 
process,  including  the  combining  or  eliminating  of  phases, 
the  using  of  concurrent  processes,  and  the  streamlining  of 
contractxial  requirements  (DoD  Manual  5000. 2-M,  1991:4-D-1- 
2) .  These  aspects,  especially  concurrency,  increase  the 
risks  associated  with  the  project,  thereby  increasing  the 
likelihood  that  schedule  delays  will  occvur  (DSMC,  1988: 
jq>pendix  A,  8-9)  . 

b.  Consideration  is  given  to  the  source  of  supply,  including 
small  disadvantaged  businesses  and  areas  where  surplus  labor 
exists  (DoD  Manual  5000. 2-M,  1991 :4-D-l-2) .  The  choosing  of 
a  supplier  for  reasons  other  than  ed>ility  to  supply  also 
increases  the  risk  of  schedule  slippage  (DSMC,  1988: 
i^endix  A,  6}  . 

c.  Consideration  is  given  to  the  conq>etitive/noncorq>etitive 
aspects  of  each  phase  of  each  acquisition,  including  how 
conq>etition  will  be  sought,  promoted,  wd  sustained  (DoD 
M£uiual  5000. 2-M,  1991:4-D-l-3) .  The  conq>etitive  process 
leads  contractors  to  underestimate  the  time  required  for 
each  task  (Bent,  1982:129-131).  Unless  this  effect  is 
amalyzed  thoroughly  at  source -selection  time,  unrealistic 
acquisition  time-scales  may  result. 


d.  Consideration  is  given  to  the  type  of  contract:  fixed-price 

or  cost-plus,  and  the  use  of  incentives  (DoD  Manual  5000.2- 

M,  1991:4-0-1-3  to  4-D-1-4) .  The  type  of  contract  can 

inqiact  schedule  performance;  for  exanple,  a  contractor 

operating  under  a  fixed-price  contract  is  more  likely  to 

produce  within  schedule,  in  addition,  the  DoO  may  use 

contract  incentives  to  induce  specific  schedule  perfomuuice 

from  the  contractor  (Nicholas,  1990:  494-499) . 

Bialc  Management.  Section  B  of  Part  5  of  DoD  Instruction  5000.2 

relates  to  risk  management.  As  stated  in  that  document: 

A  risk  management  program  shall  be  estad>lished  for  each 
acquisition  program  to  identify  euid  control  perf ormauice ,  cost,  euid 
schedule  risks  [...].  The  risk  management  program  will  consist 
of  plazming,  identification,  assessment,  analysis,  and  reduction 
techniques  to  support  sound  program  management  decisions.  (DoD 
Instruction  5000.2,  1991:5-B-1) 

The  management  of  risk  affects  every  aspect  of  acquisition  maxiagement 
(DSMC,  1988;  DoD  4245. 7-M,  1989;  NAVSO  P-6071,  1986;  and  CPG  No  8 
(draft) ,  1992) .  Effective  plauming  for,  emd  identification  of,  high 
risk  areas,  therefore,  is  essential  for  satisfactory  schedule 
performance.  Furthermore,  DoD  Directive  5000.1  states  that  "[sjchedule 
shall  lae  s\xbject  to  trade-off  as  a  means  of  keeping  risk  at  acceptable 
levels"  (DoD  Directive  5000.1,  1991:1-5).  The  implication  of  this 
directive  is  that  all  risks  --  technical,  cost,  schedule,  manufacturing, 
and  logistics  --  need  to  be  accurately  assessed  during  the  pleuining 
phase  to  ensure  that  realistic  schedule  trade-offs  and  performance- 
requirements  are  generated.  (Note,  aspects  of  risk  management  will  be 
discussed  in  more  detail  under  the  relevemt  areas . ) 
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Systems  Bnaineerina.  Section  A  of  Part  6  of  DoO  Instruction 


5000.2  relates  to  systems  engineering.  The  systems-engineering- 
manageraent  process  involves  the  integration  of  all  engineering 
disciplines  during  the  design  and  development  process  (DSHC,  1990 :Ch 
1,2) .  The  more  conqplex  the  design,  the  more  engineering  elements  will 
be  involved  and  the  more  managerial  effort  will  be  required.  This  will 
also  increase  the  risk  of  schedule  delays.  Furthermore,  engineering 
management  of  the  contractor's  design  process  involves  the 
inqplementation  and  tailoring  of  MIL-STD-1521B,  Technical  Reviews  and 
Audita  for  Systems.  Equipments,  and  Computer  Programs.  MZL-STD-1521B 
breaks  the  design  process  into  a  number  of  phases  and  milestones  (e.g.. 
Preliminary  Design  Review  (PDR) ,  Functional  Configruration  Audit  (FCA) ) . 
Typically,  each  milestone  has  a  significant  number  of  data  requirements 
associated  with  it.  The  generation  of  these  data  requirements  is  time- 
consuming  and  can  have  a  significant  inq)act  on  schedule  performance. 

Work  Breakdown  Structure.  Section  B  of  Part  6  of  DoD  Instruction 

5000.2  relates  to  the  development  of  the  work  breakdown  structure  (WBS) . 
In  accordance  with  MIL-STD-881,  Work  BreaJedown  Structures  for  Defense 
Materiel  Items,  the  SPO  will  develop  a  WBS  for  each  applicable 
acquisition.  A  WBS  is  a  "product-oriented  family  tree,  conq>osed  of 
hardware,  software,  services,  data  and  facilities”  (MIL-STD-881B 
(draft),  1992  :SeC  1,2).  Figure  2-3  provides  cm  exaiiq>le  of  a  WBS.  The 
WBS  defines  all  elements  of  the  program,  including  all  system¬ 
engineering  and  project -management  elements.  The  WBS  also  provides  the 
basis  for  the  contractor  to  schedule  the  work  to  be  performed. 
Furthermore,  the  WBS  provides  the  basis  for  the  application  of  earned 
value  management  systems  (e.g..  Cost /Schedule  Control  Systems  Criteria 
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Figure  2-4.  Example  of  a  NOrlc  BreaJcdoim  Structure 
(Andretrs  and  Adler,  1991:15) 

(C/SCSC) ) .  From  tlxe  perspective  of  schedule  management,  therefore,  the 
HBS  is  perhaps  the  most  important  planning  document. 

Specifying  the  Recruire^t 

The  specifying  of  a  requirement  involves  a  number  of  documents, 
including : 

a.  specifications, 

b .  a  Statement  of  Work  (SOW) , 

c .  a  Contract  Data  Requlrmaents  List  (CDRL) , 

d.  Data  Item  Descriptions  (DXDs) ,  and 

e.  other  documentation  required  for  a  Request  For  Proposal 
(RFP)  (e.g..  Instructions  To  Offerors  (ITO)  and  Evaluation 
Criteria)  (Beck,  1991:4-7) . 

With  respect  to  schedule  performance,  all  of  these  documents  are 
applicable  (Beck,  1991:7)  .  Through  the  application  of  the  SOW,  CDRL, 
and  DXDs,  the  contractual  requirements  for  the  contractor's  schedule 
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p«rfonMUic«  (management  and  reporting)  are  defined.  The  correct 

generation  of  the  SOW  and  CDRL,  and  the  correct  tailoring  of  DIDs, 

therefore.  Is  vital  for  an  acquisition  to  meet  Its  schedule  goals.  This  ' 

section  of  the  literature  review  will  discuss  each  of  these  dociiment 

types  from  the  perspective  of  schedtile  performance. 

Specification .  The  specification  provides  the  technical 
definition  of  the  end- items  required.  Functional  requirements  are 
included  in  the  System/Segment  Specification  (l.e..  Type  A)  amd  the 
specific  requirements  are  included  in  the  Prime  Item  Development 
Specification  (PZDS)  (l.e.,  Type  Bl)  or  the  Critical  Item  Development 
Specification  (CZDS)  (l.e..  Type  B2)  (DSMC,  1990:10-3).  An  RFP  for  a 
development  contract  could  be  issued  with  either  a  Type  A,  Type  Bl,  or 
Type  B2  specification.  Furthermore,  each  of  these  specifications  could 
be  either  partially  or  fully  developed.  The  degree  of  technical 
certainty  associated  with  a  particular  acquisition  is  provided  by  the 
type  of  specification;  that  is,  a  functional  specification  involves 
higher  technical  uncertainty  thaui  a  PIDS  or  CIDS,  euid  a  draft 
specification  involves  higher  technical  uncertainty  than  a  fully 
developed  specification.  As  technical  uncertainty  is  Icnown  to  be  a 
contributing  factor  to  schedule  slippage,  this  aspect  should  be 
considered  when  analyzing  schedule  performance  (Perry  et  al,  1971:16) . 

SOW.  The  SOW  specifies  the  "worlc  to  be  done  [by  the  contractor] 
in  developing  or  producing  the  goods  to  be  delivered”  (MIL-HDBK-245C, 

1991:4) .  The  content  of  the  SOW  is  defined  by  the  WBS,  in  that  each 
element  of  the  WBS  is  addressed  by  a  section  in  the  SOW  (MIL-HDBK-245C, 

t 

1991:15) .  The  SOW,  therefore,  includes  all  requirements  for  project 
mamagement,  including  schedule  performance  (Andrews  and  Adler,  1991:15) . 
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Furthermore,  the  SOW  specifies  the  need  for  either  C/SCSC  or  C/SSR  (if 
required) .  All  aspects  that  relate  to  schedule  management,  therefore, 

♦ 

must  be  adequately  specified  in  the  SOW,  including: 

a.  contractor's  project -management  responsibilities, 

^  b.  project  planning, 

c.  Contract  WBS  requirements, 

d.  C/SCSC  or  C/SSR  requirements, 

e.  project  scheduling, 

f.  systems  engineering  management  planning, 

g.  development  planning, 

h.  test  and  evaluation  planning, 

i.  manufacturing  planning,  smd 

i.  integrated  logistics  support  planning  (DSMC,  1990) . 

To  ascertain  whether  any  recommended  SOW  clauses  or  guidance 
instructions  were  available  to  assist  in  the  specifying  of  these 
requirements,  a  review  of  all  the  relevant  MIL-STDs  and  MIL-HDBKs, 
available  to  the  authors,  was  conducted.  This  review  revealed  that 
almost  no  standard  clauses  are  available,  and  few  guidance  instructions 
are  provided.  An  automated  contractxial  dociimentation  system,  the 
Computer  Generated  Acquisition  Documents  System  (CGADS) ,  was  found  to 
exist;  however,  a  previous  thesis  by  Zablcar  amd  Zimmerman  revealed  that 
this  system  was  consider^d>ly  out-of-date  (Zed>]car  and  Zimmemuui, 

•  1985:;^.  C,  57-58).  Since  1985,  CGADS  has  been  updated;  however,  a 

range  of'  SPO  personnel  that  were  questioned  on  the  use  of  CGADS  did  not 
^  know  that  the  system  existed.  The  implication  of  this  review  is  that 

the  specifying  of  the  schedule-management  requirements  is  either 
generated  emew  for  each  SOW  or  copied  from  am  existing  SOW. 
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CPRh  asm.  Pipe-  The  CDRL  specifies  t^ich  data  items  are  required, 
when  and  how  the  data  will  be  accepted,  where  to  look  for  preparation 
instructions,  and  where  in  the  SOW  the  preparation  effort  is  required  * 

(Beck,  1991:6) .  The  DZDs  provide  the  format  and  content  (description) 
of  each  data  item.  In  terms  of  schedule  performance,  therefore,  the  ^ 

C!DRL  and  associated  DIDs  provide  the  means  to  obtain  the  information 
which  managers  require  to  perform  the  monitoring  and  control  function. 

A  list  of  standard  DIDs  is  contained  in  DoD  S010.12-L,  Acquisition 
Manaaemont  Svstem  and  Data  Requirements  Control  List  (AMSDL) .  A  review 
of  the  AMSDL  and  existing  contracts  revealed  the  following  standard  DZDs 
which  either  have  been  or  could  be  used  to  obtain  detailed  schedule - 
performance  information: 

a.  DZ-A-3007,  Program  Schedule: 

b.  DZ-A-3009,  Program  Milestones  (Acquisition  Phase) ; 

c.  Dl-A-5004  6  S004A,  Project  Status  Report; 

d.  DI-F-6000C,  Cost  Performance  Report  (CPR) ; 

e.  DZ-F-6010A,  Cost/Schedule  Status  Report  (C/SSR) ; 

f.  DI-H-25772B,  Progress  Report; 

g.  DZ-FNCL-80448,  Life  Cycle  Cost  (LCC)  and  Independent 


Schedule  Assessment  (ISA)  Report; 

h.  DI-MGMT-80227,  Contractor's  Progress.  Statue  and  Management 
Report; 

i.  DI-M(a<T-80368,  Status  Report; 

j.  DI-MOIT-80505,  Program  Evaluation  and  Review  Technique 


1. 


DI-MISC-81183,  Master  Integrated  Program  Schedule  (MIPS) ■ 


While  the  data  items  listed  here  will  provide  schedule  information,  care 
needs  to  be  employed  in  their  utilization  to  ensure  that  only  the 
necessary  information  is  provided  to  the  Program  Manager  in  a  timely 
fashion  and  at  the  appropriate  level  of  detail.  In  specifying  schedule- 
management  requirements,  therefore,  the  ad>ility  to  be  proactive  when 
nuuiaging  schedule  is  dependent  upon  the  particular  DIDs  selected,  the 
timing  for  the  submission  of  DIDs,  and  how  the  schedule -management 
information  is  integrated  into  a  holistic  project -management  approach. 

A  current  trend,  with  respect  to  obtaining  schedule-management 
information,  appears  to  be  that  the  requisite  information  --  Gauitt 
charts,  networks,  critical  path  information,  organizational  aspects,  cuid 
resovirce  requirements  --  is  included  as  a  part  of  the  major  planning 
documents.  Some  exan^les  of  the  major  planning  DIDs,  which  contain  the 
requirement  for  detailed  schedule  information,  are  as  follows: 

a.  DI-ILSS-80395,  Integrated  Support  Plan  (ISP) ; 

b.  DI-ILSS-80531,  Logistic  Support  Analysis  Plan; 

c.  DI-ILSS-81070,  Training  Program  Development  and  Management 
Plan; 

d.  DI-MCCR-80030A,  Software  Development  Plaui; 

e.  DI-MOffr-80909,  Program  Plan.- 

f.  DI-M(»n'-81024,  System  Engineering  Management  Plam  (SEMP) ; 

and 

g.  DI-MISC-80074,  Manufacturing  Plan. 

The  timely  submission  of  schedule-management  information  requires  that 
schedule  information  be  obtained  via  a  specific  schedule  DID.  From  this 
perspective,  therefore,  the  need  for  detailed  schedule  information  to  be 


provided  in  each  of  the  preceding  plana  ia  queationed.  Furthermore, 
given  that  many  contracta  would  include  all  of  the  preceding  planning 
documenta,  the  conq>lexity  of  the  achedule-management  function  ia 
increaaed  aignificantly. 

Inatructiona  To  Offerora  and  Evaluation  Criteria.  The  ITO 

deacribea  to  the  potential  offerora  how  to  layout  their  propoaala  and 

which  information  ia  required.  From  a  achedule -performance  perapective, 

therefore,  the  ITO  detaila  to  the  offerora  the  information  that  is 

required  to  be  delivered  with  reapect  to  schedule  performance  to  ensure 

that  this  aspect  can  be  effectively  evaluated  during  source  selection. 

The  evaluation  criteria,  on  the  other  hand,  explain  to  the  potential 

offerors  how  the  proposals  will  be  evaluated,  and  which  aspects  are  of 

importance  to  the  procuring  organization. 

Evaluation  criteria  should  be  tailored  to  the  characteristics  of  a 
particular  program  and  should  include  only  those  significant 
aspects  expected  to  have  an  intact  on  the  ultimate  selection 
decision.  Bvalxiation  criteria  consist  of  three  types:  cost 
(price)  criterion,  specific  criteria,  and  assessment  criteria. 

The  cost  (price)  criterion  relates  to  the  evaluation  of  the 
offeror's  proposed  costs  (price).  The  specific  criteria  relate  to 
program  characteristics.  The  assessment  criteria  relate  to 
aspects  of  the  offeror's  proposal,  abilities,  and  past 
performance.  (AFR  70-15,  1988:14) 

These  two  sections  of  the  RFP,  therefore,  provide  insight  to  the 

offerors  of  the  relative  inq>ortance  of  schedule  with  respect  to  the 

overall  acquisition  objectives. 


Evaluating  the  Proposals 

Section  B  of  Part  5  of  DoO  Instruction  5000.2  relates  to  the 
selection  of  contractual  sovirces.  Specifically,  this  instruction  states 
that  the  source-selection  process  shall  provide  for  the  "in^artial, 
equitable,  euid  conq>rehensive  evaluation  of  each  offeror's  proposal"  (DoD 


Instruction  5000.2,  1991:10-8-1).  With  respect  to  the  evaluation  of 

schedule,  the  Instruction  states  that: 

[ . . . ]  evaluation  factors  [in]  solicitations  typically  may  include 
[...]  em  assessment  of  the  offeror's  numagement,  fincuicial, 
technical,  manufacturing,  and  other  resources  avail£dDle  or  pl2umed 
to  develop  and  produce  successfully  the  proposed  system  within 
schedule  and  resource  constraints,  [emphasis  added  to  highlight 
that  these  evaluation  factors  are  not  mandatory]  (DoD  Instruction 
5000.2,  1991:10-8-2) 

OoD  Instruction  5000.2  also  provides  a  list  of  evaluation  factors  and 
some  of  the  considerations  associated  with  these  factors.  The 
requirements  of  the  FAR,  with  respect  to  source  selection,  are 
implemented  via  Air  Force  Regulation  (AFR)  70-15,  Formal  Source 
Selection  for  Manor  Acquisitions,  and  AFR  70-30,  Streamlined  Source 
Selection  Procedures,  which  prescribe  the  policy  emd  procedures  for 
soliciting  and  evaluating  offerors'  proposals  for  major  and  non-major 
defense  acquisitions,  respectively  (AFR  70-15,  1988:1) .  AFR  70-15  amd 
AFR  70-30  also  provide  specific  guidance  on  the  areas  that  might  be 
addressed  under  cost,  specific,  amd  assessment  criteria.  Specific 
criteria  may  include  "technical,  logistics,  mauiuf acturing ,  operational 
utility,  design  approach,  readiness  amd  support,  test  and  management" 
(AFR  70-15,  1988:14).  Assessment  criteria  typically  include  such 
aspects  as  "soundness  of  technical  approach,  understauiding  of  the 
requirement,  compliance  with  the  requirement,  past  performance  and  the 
inpact  on  schedule"  (AFR  70-15,  1988:14).  Note  that  schedule  per  se  is 
not  regarded  as  a  specific  evaluation  criteria  in  either  AFR  70-i5  or 
AFR  70-30. 

Within  the  source-selection-evaliiation  process,  schedule  is 
specifically  addressed  through  risk-assessment  procedures  which  evaluate 
each  proposal  with  respect  to  cost,  schedule,  and  performauice  or 


technical  risks  (AFR  70-15,  1988:17).  As  discussed  in  Chapter  I, 
source- selection  procedures  within  Aeronautical  Systems  Center  (ASC)  are 
currently  undergoing  revision  to  incorporate  an  euialytical  schedule-risk  » 

assessment  into  the  evaluation  process.  The  current  plan  is  for  the 
Source  Selection  Evaluation  Team  (SSBT)  to  perform  eui  analysis  of  each  ^ 

offeror's  proposed  schedule  to  determine  the  90%  probable  completion 
date  (ASC/FMC,  1993:1).  Through  this  revised  methodology,  more 
realistic  program  schedules  should  result. 


Monitoring  and  Controlling  the  Resultant  Contract 

For  cost-plus  contracts  and  some  fixed-price  incentive  contracts, 

the  two  current  methods  for  monitoring  and  controlling  cost  and 

schedule,  as  introduced  in  the  history  section  of  this  literature 

review,  are  C/SCSC  (omd  associated  CPR)  and  C/SSR.  Within  these  two 

earned  value  approaches  to  cost  and  schedule  management,  schedule 

performance  is  measured  by  comparing  work  accomplished  against  work 

originally  planned,  that  is,  by  computation  of  the  schedule  varieuice .  A 

number  of  authors  (Fleming,  1988:179-187;  Niemumn,  1982:6;  Webster, 

1988:22)  have  highlighted  that  the  schedule  variance  is  problematic 

because  it  reveals  no  information  about  the  critical  path.  As  stated  in 

the  C/SCSC  Joint  Implementation  Guide  (JIG) : 

A  C/SCSC  schedule  variance  is  stated  in  terms  of  dollars'  worth  of 
work  and  must  be  analyzed  in  conjunction  with  other  schedule 
information  such  as  provided  by  networks,  Gantt  charts,  and  line- 
of-bal£uice.  By  itself,  the  C/SCSC  schedule  variamce  reveals  no 
"critical  path"  information,  euid  may  be  misleading  because 
unfavorable  accomplishment  in  some  areas  may  be  offset  by 
favoradale  accomplishment  in  others.  A  C/SCSC  schedule  variance  is 
an  "accomplishment  variance"  that  provides  em  early  indicator  of 
cost  problems  when  it  shows  the  contractor  is  not  meeting  the 
internal  work  plan.  Further  ^malysis  must  be  performed  to 
determine  the  effect  on  contract  cost  euid  schedule.  [emphasis 
added]  (C/SCSC  JIG,  1987 :vi) 
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The  analysis  discussed  in  the  previous  paragraph  is  normally 
carried  out  by  the  contractor  when  completing  either  the  CPR  or  the 
C/SSR.  These  reports  are  intended  to  be  submitted  to  the  DoD  about  25 
days  after  the  close  of  the  contractor's  accounting  month  (C/SCSC  JIG, 
1987 :vii).  The  CPR  and  C/SSR,  therefore,  provide  little  timely 
information  for  use  by  the  SPO.  Furthermore,  no  guidance  could  be  found 
as  to  how  to  appropriately  specify  the  requirements  for  an  integrated 
schedule- reporting  package  (i.e.,  a  combination  of  earned  value  .eports 
amd  network  auialysis)  . 

Summary 

This  section  of  the  literature  review  has  provided  a  discussion  of 
a  number  of  the  factors,  under  the  control  of  the  DoD,  which  have  the 
potential  to  affect  schedule  performance.  A  description  of  each  of  the 
factors  was  provided  to  show  how  each  one  fits  into  the  contractual 
process  from  a  schedule -per formauice  perspective.  Furthermore,  some  of 
the  problem  areas  and  shortfalls  were  highlighted.  While  this  is 
obviously  a  complex  problem,  DoD  personnel  also  need  am  understamding  of 
the  contractor's  environment.  The  specifying  of  requirements  in  the  RFP 
auid  the  resultamt  contract  must  be  based  on  the  capad)ility  of 
contractors  to  meet  those  requirements;  hence  the  need  to  understauid 
those  factors  under  the  control  of  the  contractor.  These  factors  are 
discussed  in  the  next  section. 
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In  the  preceding  section,  the  schedule-performance  factors  under 
the  control  of  the  DoD  were  discussed.  Some  of  those  factors  are  also 
tmder  the  control  of  the  contractor,  though  with  a  somewhat  different 
focus  than  the  DoD.  Additionally,  there  are  a  number  of  other  factors 
that  are  contractor-specific.  This  section  will  outline  some  of  the 
more  significant  factors  xmder  the  control  of  the  contractor. 
Specifically,  the  following  subjects  will  be  addressed: 

a.  work  breakdown  structure, 

b.  schedule-planning  method, 

c.  estimation  of  activity  time, 

d.  activity- responsibility  allocation, 

e.  resource  allocation,  and 

f .  risk  assessment . 

The  discussion  of  each  of  these  factors  will  clarify  the  exact  role  of 
each  factor  in  the  contractual  process,  thereby  assisting  in  the 
identification  of  cauididate  varicdiles  for  the  resultant  schedule- 
performance  auialysis.  In  the  following  paragraphs,  a  brief  description 
of  each  factor  is  provided,  followed  by  a  description  of  the 
contractor's  ediility  to  affect  schedule  performance  through  that  factor. 


Work  Breakdown  Structure  (WBS) 

Description .  The  description  of  the  WBS  was  provided  earlier  in 
the  section  on  factors  under  the  control  of  the  DoD.  In  addition  to  the 
uses  described  in  that  earlier  section,  the  WBS  performs  a  number  of 
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other  fviactiona  for  the  contractor.  From  the  contractor's  perspective, 
the  WBS  provides  a  common  frame%«ork  for: 

a.  summing  subdivided  elements  into  the  total  project, 

b.  providing  communication, 

c.  assigning  responsibility, 

d.  authorizing  vrork, 

e.  planning, 

f.  monitoring, 

g.  controlling,  and 

h.  linking  project  objectives  to  company  resources  in  a  logical 
manner  (Prentis,  1988:26). 

Contractor  Control.  While  the  WBS  may  sometimes  be  initialize^'  by 

the  OoD  in  the  SOW,  the  contractor  is  e3q>ected  to  develop  the  WBS  to  a 

level  suitable  for  management  of  the  contract. 

In  general;  1)  the  greater  the  project  cooqplexity  and  technicnl 
requirements,  the  greater  the  number  of  WBS  levels  and  [Work 
Packages]  WPs;  and  2)  the  greater  the  project  cost  auid  time  span 
of  the  project,  the  greater  the  nximber  of  WBS  levels  auid  WPs. 
(Prentis,  1988:27) 

The  contractor,  therefore,  has  direct  control  over  the  effectiveness  of 

project  management  by  the  level  of  the  WBS  (and  the  resultant  WPs) 

chosen.  This  is  reinforced  by  Powers: 

The  primacy  of  the  WBS  to  the  network  cannot  be  underestimated. 

If  there  are  doubts  about  the  necessity  of  providing  structure  to 
the  network,  remember  that  a  lack  of  structure  is  considered  "a 
killer  of  the  network  technique".  (Powers,  1988:40) 


Schedule-Planning  Method 

Description.  In  the  history  section  of  this  literature  review, 
the  Gantt  chart,  the  Program  Evaluation  and  Review  Technique  (PERT) ,  the 
Critical  Path  Method  (CPM) ,  the  Precedence  Diagram  Method  (Pim) ,  euid  the 


Graphical  Evaluation  euid  Review  Technique  (GERT)  were  introduced  as 

schedule -planning  methods.  Each  method  has  characteristics  that 

distinguish  its  usefulness  for  schedule  planning  and  control,  and  some 

methods  are  generally  superior  to  others.  Both  the  contractor  and  the 

OoO  must  understand  the  ptirpose,  advantages  and  disadvantages  of  each  of 

these  scheduling  methods  (Cori,  1985:82) .  Further  information  on  the 

advantages  and  disadvantages  of  each  method  may  be  found  in  any  project- 

mauoagement  text  (e.g.,  Nicholas,  1990). 

Contractor  Control.  The  DoD  rarely  specifies  that  a  contractor 

utilize  a  particular  schedule -planning  method;  hence,  contractors  can 

select  a  method  that  best  fits  their  purpose.  Although  that  degree  of 

flexibility  is  desired,  a  contractor's  influence  on  schedule-performance 

outcomes  stems  from  how  well  the  contractor  utilizes  the  chosen  method, 

and  whether  or  not  the  chosen  method  is  suitadile  for  the  requirements  of 

the  project  (Bubshait  and  Selen,  1992:43).  There  is  no  doubt  that 

selecting  and  inq>lementing  a  suitable  schedule-planning  method  is 

paramount  to  project  succes  ;  yet  many  project  managers  are  reluctant  to 

prepare  a  project  plan  (Cori,  1985:78;  Bitner,  1985:64;  Powers,  1988:43; 

Prentis,  1988:25;  McNeil  and  Hartley,  1986:39).  In  a  paper  on  the 

possible  use  of  expert  systems  in  project  management,  Avots  states  that: 

[ . . . ]  one  should  note  the  fact  that  most  of  the  capabilities 
already  availad3le  from  modem  project  management  systems  are  not 
used.  A  common  explanation  is  that  managers  do  not  imderstand  the 
available  techniques  and  therefore  do  not  support  their  use. 

(Avots,  1985:54) 

In  sinq>listic  terms,  "It  has  been  said  that  'Failing  to  plan  is  planning 
to  fail'”  (McNeil  and  Hartley,  1986:43). 


Batiwation  of  Activity  Time 

Description.  The  result  of  the  NBS  development  process  is  a  set 
of  wrk  packages  (WP)  that  form  a  core  from  idiich  the  total  project  time 
and  cost  estimate  are  derived.  To  estimate  total  project  time,  the 
contractor  formulates  a  time  estimate  for  each  HP  and  then  utilizes  the 
schedule  to  aggregate  those  estimates  into  an  estimated  total  project 
time  (Nicholas,  1990:249,  282).  Care  must  be  taken  during  the 
aggregation  process  due  to  task  dependencies  and  resource  constraints 
(Nicholas,  1990:  Ch  12,  Ch  13) . 

Contractor  Control.  A  time  estimate  for  each  HP  can  be  the  result 
of  detailed  )cnowledge  or  high  subjectivity,  depending  on  the 
contractor's  previous  experience.  As  projects  are  usually  unique  by 
natxure,  time  estimates  tend  to  be  subjective  and  based  on  the  previous 
experience  of  the  scheduler,  or  more  ideally  on  the  experience  of  those 
best  qualified  to  make  the  estimates  (Cori,  1985:79-80;  Nicholas, 
1990:299;  McNeil  and  Hartley,  1986:39).  Thus,  the  more  subjective  the 
time  estimation  at  the  HP  level,  the  more  extreme  the  variauice  in  the 
total  project  time  estimate.  This  effect  can  be  modelled  for  the 
project  by  consideration  of  classical  probability  theory  applied  to  HP 
time  estimates,  where  each  HP  time  estimate  is  assumed  to  be  an 
independent  random  vari^d}le  (Hamburger,  1987:83;  Toelle  and  Hitherspoon, 
1990:33) .  From  a  schedule-perfomuuice  perspective,  the  generation  of 
realistic  activity-time  estimates  is  fundamental  to  the  achievement  of 
schedule  goals. 
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D««cription.  In  ordar  to  •uccaasfully  axacuta  tha  projact,  tha 


contractor  must  assign  tha  WPs  ganaratad  by  tha  NBS  to  discrete 
departments,  internal  managers,  amd/or  subcontractors  (if  necessary) 
responsible  for  those  NPs  (Nicholas,  1990:238,  248-250;  Prentis, 

1988:27)  .  Such  delineation  of  responsibility  helps  to  avoid  "passing 
the  buck"  (Nicholas,  1990:252) .  The  planning  of  the  total  project 
schedule  can  then  involve  inputs  from  the  relevant  NP  managers.  Figure 
2-5  provides  an  exanple  of  a  task  responsibility  allocation  method  for  a 
project. 

Contractor  Control.  The  allocation  of  responsibility  for  each  WP 
has  similarities  to  the  contract  itself,  in  that  there  exists  a  client 
and  a  supplier  relationship.  Control  of  that  lower  level  relationship 


Figure  2-5.  Example  of  a  Project  Task  Responsibility  Allocation  Method 
(Nicholas,  1990:253) 
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may  wall  be  adaquata  for  the  WPs  assigned  within  the  contractor's 
organization;  however,  when  the  allocation  is  made  to  subcontractors, 
there  may  be  a  reduction  in  the  level  of  control.  Consequently, 
contractors  must  guard  against  the  erosion  of  control  when 
subcontractors  are  employed. 

Resource  Allocation 

Description.  The  resources  required  to  execute  a  project  are  many 
and  varied,  ranging  from  personnel  to  materials.  As  resources  are 
finite,  and  vrork  packages  consume  resources,  the  resources  form 
additional  project  constraints  within  the  network  precedence  arrangement 
(Bubshait  and  Selen,  1992:45;  Cori,  1985:79;  Nicholas,  1990:320-325). 

Contractor  Control.  As  the  DoD  does  not  have  'across  the  board' 
visibility  of  the  contractor's  allocation  of  resources,  the  contractor 
has  the  responsibility  to  ensure  that  the  availaUble  resovirces  are  not 
overtaxed  (Cori,  1985:79) .  If  resource  allocation  is  a  limiting  factor, 
careful  auialysis  must  be  made  of  the  time-for-resource  trade-off,  as  the 
relationship  may  not  be  linear,  may  have  no  effect,  or  may  even  be 
detrimental  (Powers,  1988:42-43;  Hamburger,  1987:81). 

Risk  Assessment 

Description.  The  risk  associated  with  a  project  schedule  is 
related  to  the  probability  of  conqpleting  the  project  on  time  (Orczyk  auid 
Hancher,  1987: A. 7.1) .  In  a  network-based  approach  to  schedule- 
management,  the  critical  path  is  defined  as  the  longest  path  through  the 
network  (Nicholas,  1990:282).  The  overall  risk,  therefore,  results  from 
the  risk  associated  with  each  task  that  lies  on  the  critical  path(s)  or 
on  the  near-critical  path(s) ;  hence,  those  tasks  should  receive  the 
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majority  of  the  numageraent  attention  (Toelle  and  Witherspoon,  1990:34; 
Hicholas,  1990:297-298). 

Different  methods  currently  exist  for  determining  the  risk 
associated  with  a  particular  schedule.  Bach  of  these  methods  has 
advantages  and  disadvantages.  A  PERT-based  approach  to  the  scheduling 
of  a  project,  for  exan^le,  provides  an  easily  calculated,  but  optimistic 
estimate  for  the  total  project  dxuration  (Nicholas,  1990:297) . 
Furthermore,  PERT  does  not  enable  resource- levelling  to  be  conducted 
(Nicholas,  1990:313). 

Contractor  Control.  To  meet  the  schedule  required  by  the  DoD,  the 
contractor  can  alter  the  estimated  time  for  each  activity,  can  change 
the  precedence  relationships  Isetween  activities,  or  cam  do  both. 
Precedence  relationships  cam  loe  described  as  natural,  environmental,  or 
preferential  (Hamburger,  1987:82).  Natural  precedence  is  unalterable, 
so  only  environinamtal  amd  preferential  relationships  cam  he  altered  by 
the  contractor,  normally  with  increased  risk  (Haunburger,  1987:82; 
Nicholas,  1990:298;  Po%rers,  1988:43).  "If  several  choices  are 
availaUDle,  the  logic  revision  involving  the  least  risk  should  be  made" 
(Powers,  1988:43).  Risk  must  be  carefully  judged  against  other  project 
factors : 

To  maucimize  the  probability  of  success,  the  project  plamner  must 
first  estadslish  a  realistic  expected  conpletion  date  --  defined  by 
the  project's  Critical  Path  --  with  no  regard  for  am  arbitrary  end 
date;  amd  then  selectively  conqpress  this  required  sequence  of 
tasks  by  judicious  resource  management  amd  prudent  risk  taJcing. 
(Hamburger,  1987:79) 

As  a  corollary  of  the  preceding  discussion,  the  positive  amd  negative 
aspects  of  the  schedule  proposed  by  the  contractor  should  be  assessed  by 
the  DoD  to  ensure  that  the  schedule  risk  is  acceptadsle.  The  DoD  camnot 


successfully  perform  this  assessment  without  an  understuding  of  the 
assumptions,  methods,  and  constraints  that  were  employed  by  the 
contractor . 

Suianarv 

This  section  has  discussed  the  factors  under  the  control  of  the 
contractor  (some  of  which  are  related  to  the  DoO  factors)  that  influence 
the  up-front  project -schedule  estimation.  Some  of  the  significant 
factors  are  the  work  breakdovm  structure,  schedule -plamning  method, 
estimation  of  activity  time,  activity-responsibility  allocation, 
resource  allocation,  and  risk  assessment.  Each  of  these  factors 
requires  careful  consideration  by  the  contractor  in  order  to  be  aible  to 
propose,  and  then  to  execute,  a  project  schedule  that  is  as  responsive, 
as  responsible,  and  as  accurate  as  possible.  The  DoD  must  also 
understand  these  factors  to  ensvire  that  the  generation  of  the 
contractual  documents,  the  source- selection  evaluation,  and  the 
ruuiagement  of  the  resultant  contract  are  performed  in  the  most  efficient 
and  effective  manner. 


This  literature  review  investigated  the  factors  relevant  to  the 
pre-contract-award  actions  by  the  DoD  and  the  resultant  schedule 
performance.  To  achieve  this,  a  brief  history  of  schedule  management  in 
the  DoD  was  provided.  Following  this,  a  review  was  conducted  of  cvirrent 
research  in  the  area  of  inprovlng  schedule  performance.  Finally,  the 


factors  under  the  control  of  the  DoD  and  the  contractor  were  discussed. 


This  literature  review  explained  how  the  factors  associated  with 
planning  the  acquisition,  defining  the  requirement,  auid  evaluating  the 
proposals  have  the  potential  to  considerably  impact  on  schedule 
performance.  Furthermore,  the  review  has  shorn  that  the  factors 
associated  with  the  contractors'  schedule-management  system  --  HBS 
development,  schedule -planning  method,  activity-time  estimation, 
activity- responsibility  allocation,  resource  allocation,  auid  risk- 
assessment  capability  --  need  to  be  understood  by  the  DoD  and 
appropriately  addressed  throughout  the  contractual  process. 

In  essence,  the  factors  relevant  to  the  pre- contract -arard  actions 
by  the  DoD  are  those  which  are  implemented  through  the  Acquisition  Plan, 
the  RFP,  and  the  resultcuit  contract.  To  achieve  acceptcd^le  schedule 
performance,  therefore,  the  relevant  component  documents  of  the  RFP 
and/or  contract  --  SOW,  CDRL  and  DIDs,  ITO,  and  Evaluation  Criteria  -- 
must  clearly  delineate  requirements  that  are  reasonaUble,  realistic,  euid 
have  been  shown  to  positively  affect  schedule  perf ormouice .  To  achieve 
this,  the  DoD  requires  an  understcuiding  of  all  the  factors  that  have  the 
potential  to  affect  schedule -performance,  their  interactions,  euid  the 
appropriate  ways  to  incorporate  those  factors  into  the  contractual 
process . 

Chapter  III  will  build  on  the  factors  covered  in  this  chapter  euid 
will  address  the  methodology  enqiloyed  in  this  study.  Specifically,  the 
population  and  sanq>le  are  discussed,  and  the  data-collection  instmment 
and  data  sources  are  addressed.  Finally,  .the  statistical  tests, 
required  to  euiswer  the  investigative  questions,  are  presented. 


III.  Methodology 


Introduction 

The  p\irpose  of  this  study  was  to  describe  and  characterize  the 
relationship  between  pre- contract -a«iard  management  actions  by  the  DoD 
and  the  resultant  schedule  performance.  As  stated  in  Chapter  I,  to 
achieve  this  purpose  required  the  identification  of  the  relevant 
actions,  and  the  measurement  of  the  degree  of  inqpact  that  each  of  those 
actions  had  on  schedule  performance. 

This  chapter  of  the  thesis  addresses  the  methodology  used  for  this 
research  and,  specifically,  covers  the  following  topics: 

a.  an  explanation  and  justification  of  the  methodology 
en^loyed, 

b.  a  description  of  the  population  and  sample, 

c.  a  discussion  of  the  instrument  development  and  testing, 

d.  a  discussion  of  the  data  collection, 

e.  a  discussion  of  the  statistical  techniques  enployed, 

f.  a  listing  of  the  operational  definitions  appropriate  to  the 

thesis,  and 

g.  a  svunmary  of  the  chapter. 

Explanation  and  Justification  of  the  Methodology 

The  methodology  employed  in  addressing  the  research  question 
followed  directly  from  the  research-design  classification.  Furthermore, 
the  statistical  techniques  employed  followed  directly  from  the 


investigative  questions.  Both  of  these  aspects  are  discussed  further  in 
this  section. 

Research-Design  Classification 

nie  research- design  classification  format  presented  by  Emory  and 
Cooper  was  used  to  frame  this  research  (Emory  and  Cooper,  1991:139-144) . 
Initially,  as  a  research  question  and  associated  investigative  questions 
were  able  to  be  formulated,  the  research  liras  classified  as  a  formal 
study.  Furthermore,  to  address  the  investigative  questions,  record 
analysis  of  past  contracts  needed  to  be  conducted;  the  research, 
therefore,  was  further  sub-classified  as  observational  and  ex  post  facto 
in  design.  Finally,  to  conduct  the  study,  many  contracts  over  a  number 
of  years  needed  to  be  examined;  hence,  the  study  was  also  sub-classified 
as  longitudinal  in  nature. 

Statistical  Technigues 

To  satisfactorily  answer  the  investigative  questions,  the 
relationship  between  a  number  of  independent  variad}les  (i.e.,  pre¬ 
contract-award  planning,  scheduling,  and  evalxiating  variables)  auid  a 
single  dependent  variable  (i.e.,  schedule  perfornumce)  needed  to  be 
analyzed.  Furthermore,  the  thrust  of  the  investigative  questions 
resulted  in  the  need  for  a  predictive  model  of  schedule  performance. 

Many  texts  provided  guidance  in  selecting  appropriate  statistical 
techniques;  given  the  nature  of  the  investigative  questions,  regression 
analysis  was  the  recommended  technique  (Emory  euid  Cooper,  1991:629; 
Andrews  et  al,  1981:3-30;  Devore,  1991:453-454) .  Detailed  discussion  of 
the  actual  regression -techniques  enq>loyed  in  this  thesis  are  presented 


later  in  this  chapter. 


Description  of  the  Population  and  Sample 


Population 

The  population  of  interest  in  this  study  consisted  of  all  DoD 
acquisition  contracts  which  were  below  the  threshold  ’-/here  the  Cost/ 
Schedule  Control  Systems  Criteria  (C/SCSC)  were  mandated,  and  which 
involved  either  design  and  development  or  systems  integration.  The 
population  was  limited  to  those  contracts  below  the  C/SCSC  threshold  to 
avoid  many  of  the  confounds  that  could  arise  from  high-value, 
politically-sensitive  acquisitions.  In  general,  the  contracts  of 
interest  were  those  let  in  Phase  IZ  of  the  DoD  Acquisition  Cycle ; 
Engineering  2uid  Manufacturing  Development  (EMD)  (DoD  Instruction  S000.2, 
1991:2-1) .  A  population  size  could  not  be  ascertained,  however  the 
population  was  certainly  expected  to  n\unber  many  thousands. 

Sampling  Frame 

For  economic  and  convenience  reasons,  the  population  was  narrowed, 
via  a  sampling  frame,  to  only  include  USAF  contracts  below  the  C/SCSC 
threshold  at  WPAFB.  Furthermore,  the  sampling  frame  limited  the 
contracts  of  interest  to  those  within  approximately  the  last  15  years, 
as  files  for  acquisitions  outside  this  time- frame  were  expected  to  be 
difficult  to  locate.  This  sanpling  frame  was  considered  to  be 
representative  (and,  therefore,  unbiased)  because  all  Services  are 
mandated  to  use  the  same  acquisition  procedures  (e.g..  Federal 
Acquisition  Regulations,  DoD  5000  series  of  Directives  and  Instructions, 
etc) .  Furthermore,  WPAFB  has  been  the  major  acquisition  center  within 
the  USAF;  hence,  the  sampling  frame  was  considered  to  be  representative 
of  DoD  acquisition-contracting  practice. 


Sample  Size 


Due  to  the  unique  and  exploratory  nature  of  the  research,  coupled 
with  the  extensive  primary  data- collection  effort  required  (as  there 
were  no  secondary  data  sources  in  existence  with  all  of  the  relevant 
information) ,  the  sample- size  requirements  were  not  derived  using 
standard  statistical  guidelines.  Instead,  the  sample  size  was  left 
open-ended  and  subject  to  the  vagaries  of  the  data-collection  process, 
as  outlined  in  Chapter  I  and  further  described  in  this  chapter. 

Neter,  Wasserman,  and  Kutner  recommend  that,  as  a  general  rule  of 
thumb,  there  should  be  at  least  six  to  ten  cases  for  every  independent 
variable  in  a  regression  model  (Neter,  Wasserman,  auid  Kutner,  1989:435)  . 
under  this  guidance,  therefore,  the  number  of  variables  that  will  be 
able  to  be  fitted  in  a  regression  model  will  be  constrained  by  the 
actual  sample  size  obtained. 

From  a  statistical  standpoint,  the  larger  the  sanple  size,  the 
greater  the  statistical  power,  cuid  the  more  variables  that  can  be  fitted 
in  the  regression  model.  With  this  understanding,  the  largest  sample 
size  obtainable,  within  the  available  time,  was  achieved.  A  total  of  29 
contracts  were  measured;  however,  schedule-performance  information  was 
only  able  to  be  obtained  for  25  of  these  contracts.  The  four  contracts, 
for  which  schedule-performance  information  was  not  eUble  to  be  obtained, 
were  retained  in  the  database  to  increase  the  sample  size  for  any 
deductions  auid  inferences  not  related  to  regression  modelling.  The 
sample  size  of  25  was  believed  to  be  small  in  conparison  to  the 
population  (i.e.,  less  tham  5%).  This  sample  size,  however,  provides  a 
reasonable  ability  to  fit  a  small,  yet  mwagerially  significant,  set  of 
variadsles  to  a  regression  model. 


Overview  of  the  Contracts  Measured 


The  contracts  measured  ranged  from  as  early  as  1976" through  to 
1991.  Many  other  potentially-measurable  contracts  existed  in  the  SPOs; 
homver,  contracts  more  recent  thaui  1990  had  not  progressed  sufficiently 
for  an  adequate  measure  of  schedule  performance  to  be  obtained.  A 
complete  listing  of  the  29  contracts  that  were  measured  is  provided  at 
J^pendix  C. 

The  majority  of  the  contracts  in  the  sample  (IS)  were  obtained 
from  the  Training  (YT)  SPO,  while  the  remainder  were  obtained  from  a 
variety  of  SPOs  and  Directorates,  including  the  Subsystems  (SM)  SPO  (7) , 
the  Aircraft  (SD)  SPO  (3),  the  Contracting  (PK)  Directorate  (2),  the 
Electronic  Combat  and  Reconnaissauice  (EC/Reconn)  (RW)  SPO  (1) ,  and  the 
Short  Range  Attack  Missile  II  (SRAM  II)  (YG)  SPO  (1) .  The  contracts 
involved  a  variety  of  different  requirements:  development  of  training 
systems,  software  development,  aircraft  modification,  development  of 
missiles,  and  development  of  specifications.  In  a  very  real  sense, 
therefore,  the  contracts  met  the  requirement  that  the  sample  be 
representative  of  DoD  contracting  practices. 

To  enable  all  contracts  to  be  evaluated  in  eui  equivalent  fashion, 
it  was  first  necessary  to  convert  the  face  value  of  each  contract  into 
constant  dollars.  Price  Indexes  for  Federal  Government  purchases  for 
each  year  were  obtained  and  the  face  values  of  the  contracts  were 
adjusted  to  1987  constant  dollars  (Department  of  Commerce,  1992:33). 

The  face  values  of  the  contracts  varied  from  $2,135,900  to  $216,604,100 
in  constauit  dollar  terms.  A  histogram  showing  the  range  of  contract 
face  values  in  constant  dollars  is  given  in  Figure  3-1.  All  reference 


to  contract  face  value,  from  this  point,  will  be  in  terms  of  1987 
constant  dollars . 

Seven  of  the  contracts  measured  required  Cost  Performance  Reports  * 

(CPRs)  to  be  submitted  in  accordance  with  C/SCSC  requirements.  While 
these  contracts  did  not  meet  the  specified  project-characteristic  « 

criteria,  they  were  included  in  the  sample  for  a  niunber  of  reasons.  One 
of  the  contracts  started  out  as  a  C/SCSC  contract,  but  was  changed  to 
C/SSR  via  a  contract  modification.  Four  of  the  contracts  that  required 
C/SCSC  were  of  relatively  low  dollar  value  (i.e.,  $8,068,600, 

$9,557,800,  $24,883,000,  and  $25,738,400  in  1987  constamt  dollars);  the 
utilization  of  C/SCSC,  therefore,  was  not  considered  necessary,  and  the 
contracts  were  treated  as  if  C/SSR  had  been  specified.  The  sixth  and 


Figure  3-1.  Histograun  of  the  Face  Value  of  the  Contracts  in  the  Sample 
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seventh  contracts  which  required  C/SCSC  vere  measured  in  a  time  of 
frustration  when  contracts,  which  met  the  requirements  emd  for  which  all 
the  docximents  were  available,  were  not  forthcoming.  Schedule - 
performance  information  was  not  able  to  be  obtained  for  these  two 
contracts  and  they  were  retained  in  the  sample  for  the  reasons  provided 
earlier. 


Instrument  Development  amd  Testing 

The  factors  that  were  expected  to  have  aui  impact  on  schedule 
performance  were  discussed  in  Chapter  II.  These  factors  were  converted 
into  a  candidate  variable  list,  a  copy  of  which  is  given  at  ;q>pendix  B. 
Content  validity  of  the  candidate  variable  list  was  assessed  using 
personnel  from  the  Source  Selection  Office,  ASC,  WPAFB.  The  factors  in 
the  candidate  variable  list  relate  to  pre-contract-award  management 
actions  only;  however,  to  adequately  assess  schedule  perf omuuice ,  other 
factors  must  also  be  considered.  Additional  factors  were  selected  to 
address  either  the  direct  measurement  of  schedule  performance  or  the 
measurement  of  confoxind  and/or  moderator  variables  (e.g.,  project 
characteristics  and  post-contract-award  management  actions) . 

When  the  list  of  potential  variedsles  was  considered  to  be 
conqplete,  a  standard  Data  Collection  Instriiment  (DCI)  was  developed. 
This  DCI  was  refined  during  the  data-collection  process;  a  (reduced) 
copy  of  the  final  DCI  is  presented  in  Figure  3-2.  The  DCI  is  laid  out, 
as  follows: 

a.  pase  1:  contract  details  and  project  characteristics; 

b.  page  2:  plauming  variables; 


c.  page  3:  specifying  variables;  amd 

d.  page  4:  evaluating  variables. 

The  variables  being  measured  within  each  of  these  groups  are  explained 
in  the  following  paragraphs. 

PCI  Page  One;  Contract  Details  and  Project  characteristics 

Most  elements  on  the  first  page  are  self-explanatory;  hovrever, 
others  require  some  clarification  of  meaning  and  intent. 

CLIN.  Generally,  each  contract  deliverable  or  group  of 
deliverables  is  specified  via  an  allocated  Contract  Line  Item  Number 
(CLIN) .  The  developmental  item  is  typically  CLIN  0001,  while  data  auid 
other  support  elements  are  itemized  separately  under  subsequent  CLINs  or 
sub-CLINs.  For  developmental  contracts,  production  quantities  may  be 
specified  as  either  follow-on  CLINs  or  option  CLINs  (though  this  is  not 
always  the  case) .  For  the  purposes  of  this  thesis,  only  the 
developmental  portion  of  the  contract  was  of  interest;  therefore,  only 
the  CLIN(s)  which  detailed  the  developmental  item(s)  was  (were) 
recorded. 

Description.  The  Description  field  provided  for  the  name  of  the 
contract  (i.e.,  the  item(s)  being  procured). 

Dollar  Value.  The  Dollar  Value  field  provided  for  the  cost  of  the 
contract  when  originally  let  (i.e.,  face  value);  typically,  the  cost  of 
the  developmental  item  emd  associated  support  elements.  For  sitiiations 
where  this  was  not  the  case,  the  cost  of  the  developmental  item  was 
separately  specified  in  the  designated  field. 


Number  of  Ihiits  Procured.  The  Number  of  Units  Procured  field 
inclvided  only  the  (quantity  of  items  actually  being  procured  when  the 


Figure  3-2:  Data  Collection  Instrument 
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contract  was  originally  let,  not  including  any  options.  Generally, 
given  that  the  developmental  portion  of  the  contract  was  the  focxis  of 
measurement,  this  field  reflected  the  number  of  developmental  items 
being  procured. 

Contract  Type.  The  Contract  Type  field  described  whether  the 
contract,  when  let,  was  fixed-price  or  cost-plus,  and  which  type  of 
pricing  arrangement  (e.g.,  incentives  and  amrd  fees)  was  used.  The 
scale  chosen  for  this  field  reflected  an  increasing  risk  on  the  DoD, 
i.e.,  a  fixed-price  contract  involved  acceptance  of  total  risk  by  the 
contractor,  whereas  a  cost-plus  contract  involved  total  risk  accept^ulce 
by  the  DoD.  This  dichotomy  tiras  fuirther  moderated  by  the  inclusion  of 
performance  incentives. 

During  the  data-collection  process,  it  was  discovered  that  some 
contracts  utilized  a  mixture  of  contract  types  for  different  portions  of 
the  contract.  For  the  developmental  portion,  however,  a  single  contract 
type  was  always  able  to  be  identified. 

When  the  DCI  was  originally  developed,  the  expectation  was  that 
four  contract  types  would  cover  the  contracts  in  the  sanqpling  frame: 

a.  firm  fixed-price  (FFP) , 

b.  fixed-price- incentive  firm  target  (FPXF) , 

c.  cost-plus-incentive-fee  (CPIF) ,  and 

d.  cost -plus -award- fee  (CPAF) . 

During  the  data-collection  process,  however,  two  other  contract  types 
were  found:  fixed-price -incentive  successive  targets  (FPIS)  and  cost- 
plxis-fixed-fee  (CPFF) .  To  minimize  the  number  of  levels  for  this 
variable,  the  FPIS  contract  was  treated  as  a  FPZF  contract  auid  the  CPFF 


contract  was  treated  as  a  CPIF  contract. 


Sole-source  /  Conpctitive.  The  Sole -source  /  Coopetitive  field 
reflected  the  nature  of  the  procurement  process  from  a  competition 
standpoint.  For  reasons  that  are  discussed  in  the  following  paragraph, 
this  field  vras  not  completed. 

During  the  data-collection  process,  it  was  discovered  that  sole- 
source  contracts  were  not  generally  let  using  the  standard  RFP  approach 
because  source -select ion  evaluation  was  not  required.  While  the  RFP  for 
a  sole-source  contract  generally  contained  a  SOW,  a  CDRL,  OIDs,  and  a 
specification,  it  did  not  contain  a  Section  M,  'Evaluation  Factors  for 
Award,'  and,  sometimes,  it  did  not  contain  a  Section  L,  'Instructions  to 
Offerors.'  The  sole-source  contracts,  therefore,  did  not  contain  auiy 
evaluating  variables.  To  include  these  contracts  in  the  analysis  would 
have  most  likely  required  that  a  stratification  of  the  sample  be  made 
based  on  competition.  This  would  have  resulted  in  an  increase  in  the 
sample-size  requirements  and  in  the  complexity  of  the  analysis.  For 
these  reasons,  sole-source  contracts  were  not  measured,  though  the 
spaces  on  the  first  and  second  pages  of  the  DCZ  were  retained  where  the 
competitive  nature  of  the  contract  was  intended  to  be  annotated. 

Small  Business  Set-Aside.  The  Small  Business  Set-Aside  field 
moderated  the  previous  field  to  reflect  that,  even  when  competitively 
bid,  the  bidders  were  restricted  to  small  businesses.  For  reasons  that 
are  discussed  in  the  following  paragraph,  this  field  was  not  completed. 

During  the  data-collection  process,  it  was  discovered  that  many 
competitive  Small  Business  Set-Aside  contracts  were  not  let  using  the 
standard  RFP  approach.  A  ntimber  of  different  sit\iations  were 
identified,  one  of  which  is  described  here.  Small -business  contractors 
that  were  interested  in  a  particular  contract  were  assessed,  via  a  site 
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visit,  for  their  capability  to  meet  the  requirements  of  the  contract. 
The  contractor  that  was  deemed  to  be  the  most  suitable  was  then 


requested  to  respond  to  an  RFP.  Under  this  sceaoario,  a  Section  M  was 
not  \ised  and  the  resultant  contract,  therefore,  was  not  suitable  as  a 
candidate  for  this  research.  Due  to  the  difficulties  associated  with 
measuring  Small  Business  Set-Aside  contracts,  it  was  considered  that  a 
representative  sample  of  these  contracts  would  not  be  obtainable.  For 
these  reasons.  Small  Business  Set-Aside  contracts  «rere  not  measured, 
though  the  space  on  the  first  page  of  the  OCX  was  retained  where  the 
measurement  of  this  aspect  was  intended  to  be  annotated. 

Development  Only  /  Development  and  Production.  The  Development 
Only  /  Development  and  Production  (D/D&p)  field  pertained  only  to  the 
CLIN(s)  acttially  placed  on  contract  when  originally  let.  If  the 
production  requirements  vrere  included  as  options,  the  next  field  was 
relevant . 

Options  for  Production  units.  The  Options  for  Production  Units 
field  provided  information  on  whether  or  not  production  options  were 
placed  on  contract  (as  option  CLINs) ,  and  the  quantity.  This  field  auid 
the  previous  one  allowed  for  an  assessment  of  the  total  estimated 
production  quantity,  and  of  the  degree  of  certainty,  to  the  contractor, 
of  the  production  quantities. 

Contract  Start  Date.  The  Contract  Start  Date  field  provided  the 
effective  date  of  the  contract,  as  shown  on  the  face  page  of  the 
contract . 

Planned  and  Actual  Finish  Dates.  The  Planned  auid  Actual  Finish 
Date  fields  generally  measured  the  delivery  of  the  developmental 
item(s) ;  however,  where  this  point  was  not  reached,  the  latest 


raeaatirable  point  in  the  contract  tms  used.  This  tactic  was  employed  to 
increase  the  sample  size.  To  provide  useful  comparisons,  contracts 
which  had  not  reached  Critical  Design  Review  (CDR)  were  not  assessed. 

If  a  contract  met  the  appropriate  criteria  (i.e.,  development,  not 
C/SCSC,  and  post-CDR)  and  the  delivery  date  had  not  been  reached,  the 
most  recent  estimate  of  the  delivery  date  was  used.  In  all  cases,  the 
point  of  measiirement  was  annotated  in  the  appropriate  field. 

Number  of  BCPs/CCPs  (at  Finish  Date) .  In  recognition  of  the 
effect  that  post -contract -award  actions  may  have  on  schedule 
performance,  a  variable  was  included  to  captvire  the  n\unber  of  approved 
contract  modifications  (e.g..  Engineering  Change  Proposals  (BCPs)  and 
Contract  Change  Proposals  (CCPs) )  at  the  measured  completion  date.  This 
variaUale  was  an  attempt  to  encapsulate,  as  a  surrogate  variadale,  the 
effect  of  aiJ  post-contract-award  actions  on  the  resultant  schedule 
performance.  For  contracts  where  an  estimated  completion  date  was  used, 
the  value  of  the  nvimber  of  ECPs/CCPs  variable  was  scaled,  as  explained 
later  in  this  chapter. 

PCI  Page  Two;  Planning  Variables 

The  variables  measured  in  this  section  were  mainly  gathered  from 
the  Acquisition  Plan  (AP) .  Very  few  of  the  variad^les,  therefore, 
reflected  'planning'  per  se;  instead,  they  reflected  the  Project 
Manager's  vinderstanding  of  the  project  characteristics  auid  requirements 
dtiring  the  planning  phase.  These  variables  were  selected  because  the 
information  required  to  measure  the  adequacy  of  planning  was  not 
generally  availad>le  in  contract  files;  to  obtain  insight  into  the 
reasons  for  selecting  a  particular  acquisition  strategy,  knowledge  of 


the  planning  team's  thought  processes  was  required.  The  variables 
included  in  this  section,  however,  permitted  an  assessment  of  how  well 
the  summary  measures  of  a  project  (e.g.,  assessment  of  risk)  were 
related  to  project  schedule  performance. 

Schedule  Strategy.  In  the  Schedvile  Strategy  field,  three  sub¬ 
variables  trare  measured:  was  the  acquisition  pre- scheduled,  was  the 
schedule  considered  aggressive,  and  was  concurrency  considered  to 
achieve  the  schedule  requirements?  Pre-scheduling  reflected  that  a 
schedule,  other  than  the  one  that  the  bidders  believed  optimum,  was 
forced  on  the  resultant  contractor.  A  schedule  that  was  believed  to  be 
aggressive  reflected  that  the  resultant  contractor  would  have  to  'pull  a 
large  number  of  rabbits  out  of  the  proverbial  hat'  to  meet  the  schedule 
requirements.  Concurrency  generally  occurs  between  development  and 
production,  and  is  thought  to  affect  only  the  production  units;  however, 
concturrency  also  places  the  contractor  vinder  pressure  to  finalize  the 
prototype  design  (perhaps  before  the  contractor  is  ready  to  do  so) ,  and, 
in  the  context  of  this  thesis,  was  measured  from  this  perspective. 

Sources  of  Supply.  The  Sources  of  Supply  field  measured  what  was 
planned  from  a  competitive  perspective,  as  opposed  to  what  actually 
occurred.  The  limited  scale  of  measurement  was  chosen  because  it  was 
believed  that  a  non-con^etitive  bid  would  contain  different  schedule- 
development  pressiires  than  a  schedule  developed  under  a  competitive 
approach.  An  RFP  aimed  at  three  or  more  companies  was  felt  to  reflect  a 
fully  competitive  acquisition,  whereas  an  RFP  aimed  at  two  companies  was 
felt  to  reflect  an  intermediate  position.  During  the  data-collection 
process,  this  field  was  not  conpleted  for  the  reasons  given  under  the 
section  pertaining  to  the  Sole- source  /  Conpetitive  field. 


PiannwH  Contract  Type.  The  Planned  Contract  Type  field  mirrored 


the  actual  Contract  Type  field  described  previously.  The  rationale 
behind  this  approach  was  to  detect  any  differences  between  the  planned 
and  actual  contract  types. 

Schedule  Risk.  The  Schedule  Risk  field  measured  the  Program 
Hanager's  beliefs  with  respect  to  the  schedule  risks  associated  with  the 
selected  acquisition  strategy.  Theoretically,  an  acquisition  with 
higher  schedule  risk  should  reflect  a  program  that  requires  more 
attention  to  detail  with  respect  to  schedule  management,  and  a  program 
that  requires  more  stringent  monitoring  of  schedule  performance.  The 
assessment  of  schedule  risk,  therefore,  should  capture  both  these 
perspectives . 

Technical  Risk.  Technical  uncertainty  is  known  to  be  a  driver  of 
schedule  performance  (Drezner  and  Smith,  1990:45;  Merrow  and  Yarossi, 
1990:H.€.4).  The  Technical  Risk  field,  therefore ,  enabled  an  assessment 
of  this  perspective.  Furthermore,  the  interactive  nature  of  technical 
risk  2uid  schedule  risk  was  able  to  be  addressed  through  these  measures. 

Complexity .  The  Conq>lexity  variable,  a  project-characteristic 
variable,  was  included  on  the  expectation  that  the  more  conq>lex  the 
acquisition,  the  greater  the  likelihood  for  schedule  overruns. 
Furthermore,  management  requirements  were  expected  to  increase  as  the 
complexity  increased.  The  variables  chosen  to  attempt  to  measure 
complexity  were:  cost /unit,  number  of  pages  in  the  SOW,  and  the  n\imber 
of  DIDs. 

Work  Breakdown  Structure.  The  WBS  was  considered  to  be  the 
primary  planning  document;  hence,  this  variable  was  used  to  assess  the 
adequacy  of  the  plaiming  effort.  MIL-STD-881  is  the  document  from  which 
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«  WBS  is  generated,  and  the  WBS  is  intended  to  be  tailored  as  required 
for  each  program  (especially  for  small-scale  acquisitions) .  Three  sub¬ 
variables  were  measured:  the  degree  of  development  of  the  WBS,  the 
number  of  elements  at  level  three  of  the  WBS,  and  the  lowest  level  to 
which  the  WBS  was  developed.  (Note,  a  SOW  or  DID  that  sinq>ly  called  out 
MZL-STD-881  as  the  starting  point  for  the  WBS  was  assessed  as 
undeveloped.)  Interestingly,  during  the  data-collection  process,  the 
Preliminary  WBS  was  usually  found  in  the  section  of  the  ITO  pertaining 
to  the  cost  requirements. 

Draft  RFP.  The  Draft  RFP  field  meas\ured  whether  or  not  a  draft 

RFP  was  released  to  Industry  for  comment.  While  a  'Yes'  response 

indicated  better  planning,  a  draft  RFP  may  also  have  improved  the 
» 

quality  of  the  requirements-specification;  hence,  this  variable  provided 
an  overlap  between  planning  and  specifying. 

PCI  Page  Three;  Specifying  variables 

Specification .  The  Specification  field  measured  the  level  of 
specification  that  was  placed  on  contract;  specifically,  whether  a  Type 
A  (functional  /  system)  or  a  Type  B  (prime  item  development) 
specification  was  used,  and  whether  the  specification  was  either 
complete  or  in  draft  form. 

Develop  WBS  Further.  The  Develop  WBS  Further  field  captured 
whether  the  SOW  tasked  the  contractor  with  further  development  of  either 
the  Preliminary  WBS  (supplied  by  the  DoD)  or  the  Contract  WBS  that  was 
supplied  as  part  of  the  contractor's  proposal. 

C/SSR  Required.  The  C/SSR  field  captured  whether  a  requirement 
for  cost/schedule  management,  in  accordance  with  C/SSR  provisions,  was 


placed  on  contract  and  whether  the  infomation  provided  under  this 
requirement  was  coupled  with  network  information  to  provide  an 
integrated  schedule-management  approach.  As  discussed  earlier,  the  four 
contracts,  for  which  it  was  believed  that  the  C/SCSC  guidance  had  been 
inappropriately  applied,  were  treated  as  if  C/SSR  provisions  had  been 
specified. 

Specific  Schedule -Munitawment  Paragraphs.  The  overall  management 
of  schedule  can  only  be  achieved  if  the  DoD  has  visibility  of  the 
contractor's  schedule  and  how  that  schedule  is  updated  throughout  the 
contract;  hence,  the  contractor  <thould  be  tasked,  via  the  CDRL,  with 
providing  the  necessary  schedule  information  in  the  appropriate  DID 
format.  Six  sttb- variables  were  measured:  the  format  of  the  schedule 
information  (i.e.,  Gantt  chart,  deterministic  network  euid  associated 
critical  path,  or  probabilistic  network  (e.g.,  PERT)  and  associated 
critical  path) ,  whether  near- critical  paths  were  required  to  be 
identified,  and  whether  resource  constraints,  both  within  eUid  between 
programs,  were  required  to  be  identified  cuid  evaluated. 

Frequency  of  Reporting  Schedule  Management  Information.  The 
ability  to  be  proactive  with  respect  to  schedule  management  is  dependent 
upon  the  frequency  with  which  schedule  information  is  provided  to  the 
DoD.  This  field  was  divided  into  five  areas  on  an  ordinal  scale,  in  an 
attempt  to  assess  this  ability,  as  follows: 

a.  as  slippage  occurs, 

b.  quarterly  or  less, 

c.  monthly, 

d.  as  slippage  is  foreseen,  or 
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e.  either  the  second  or  the  third  in  combination  with  the 
fourth . 

The  first  of  these  measures  captures  only  a  reactive  approach,  whereas 
the  next  two  capture  the  possibility  of  a  proactive  approach.  The 
fourth  measure  captures  that  reporting  of  schedule -management 
information  only  occurs  if  slippage  is  foreseen  (i.e.,  proactively), 
while  the  fifth  measure  captures  a  more  conservative  approach  where 
regular  reporting  is  combined  with  the  proactive  approach. 

CDRL/DlDs .  The  ability  to  manage  cm  acquisition  within  schedule 
depends  not  only  upon  the  ..schedule- specif ic  information  provided,  but 
also  upon  the  related  project -mcmagement  information  provided.  This 
field  measured  the  number  of  DIDs  related  to  project  management; 
ho';;ever,  only  the  top-level  DIDs  were  considered.  Specifically,  the 
following  types  of  DIDs  were  included: 

a.  schedule-specific  information, 

b.  program  management  plans, 

c.  contract  requirements  implementation  plans, 

d.  WBS  development  information, 

e.  system  engineering  management  plems, 

f .  development  plans , 

g .  mcmuf acturing  plans , 

h.  integrated  support  plans, 

i.  logistic  support  analysis  plans, 

j .  system  test  plans , 

k.  training  development  emd  support  plems, 

l.  quality  program  plans,  and 

m.  progress /status  reports. 


A  list  of  DIDs  which  were  considered  to  be  relevant  is  contained  at 
i^pendix  O.  Note  that  euiy  DIDs  that  related  to  a  level  of  management 
below  that  given  in  the  aforementioned  list  (e.g.,  support  equipment 
plans,  training  equipment  plans)  were  excluded. 

PCI  Page  Four;  Evaluating  Variables 

Evaluation  Criteria.  The  Evaluation  Criteria  field  atten^ted  to 
capture  the  importance  of  schedule  in  the  evaluation  process,  as 
elucidated  to  the  contractor  in  the  RFP.  The  expectation  associated 
with  this  varijdsle  was  that  the  number  of  explicit  references  to 
schedule,  mentioned  in  Section  M  (Evaluation  Factors  for  Award)  of  the 
RFP,  provides  contractors  with  insight  into  the  relative  importance  of 
this  performance  criteria  to  the  DoD  and,  hence,  the  priority  t]iat  each 
contractor  should  place  on  schedule-management  aspects. 

Schedule-Rislc  Assessment  Information.  The  ability  of  the  DoD  to 
perform  a  schedule- rislc  assessment  is  believed  to  be  directly  related  to 
the  amount  and  type  of  schedule  information  provided  by  a  contractor 
within  the  RFP  response.  This  field  measured  the  type  and  depth  of 
schedule  information  that  was  requested  by  the  DoD  in  Section  L 
(Instructions  to  Offerors  (ITO))  of  the  RFP.  Specifically,  ten  sub- 
varicUsles  were  measured,  as  follows: 

a.  Has  the  contractor  requested  to  provide  a  descriptive 
explemation  of  schedule  rislcs? 

b.  In  which  format  was  the  schedule  information  requested  to  be 
provided  (i.e.,  Gantt  chart,  deterministic  networ)c  emd 
associated  critical  path,  or  probcUoilistic  networlc  (e.g., 
PERT)  and  associated  critical  path) ? 


c.  Were  near-critical  paths  required  to  be  identified? 

d.  Here  resource  constraints,  both  within  and  between  programs, 
required  to  be  identified  and  evaliiated? 

e.  Here  separate  schedules  required  for  a  number  of  different 
confidence  levels  (e.g.,  50%  and  90%)? 

f.  Has  a  program  length  simulation  study  required? 

g.  Has  the  allocation  of  prograun-specific  responsibilities 
required  to  be  identified? 

These  sub-variables  measured  the  extent  to  which  the  information 
requested  by  the  DoD  facilitated  the  performance  of  a  schedule  risk 
assessment . 

Stunmarv  of  Instrument  Development  and  Testing 

This  section  of  Chapter  III  has  presented  the  DCI  and  the 
associated  planning,  scheduling,  and  evaluating  factors  that  were 
considered  to  have  the  potential  to  affect  schedule  performance.  The 
intuitive  outcome  for  each  of  these  factors  was  also  described.  The 
next  section  will  detail  the  execution  of  the  data  collection. 

Data  Collection 


introduction 

The  collection  of  the  requisite  data  proved  to  be  more  difficult 
and  time-cons\iming  than  was  originally  envisaged.  An  overview  of  the 
methodology  employed  to  obtain  the  resultemt  sanple  is  presented  in  this 
section,  in  the  hope  that  the  insights  gained  through  these  efforts  will 
be  of  benefit  to  future  thesis  teams. 
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Obtaining  tho 


nafrahaaafl-  The  contracts  required  for  this  research  were  those 
which  involved  design  and  development,  and  which  were  below  the  C/SCSC 
threshold.  The  database  from  which  the  requisite  sample  was  expected  to 
be  obtained  was  the  Acquisition  Management  Information  System  (AMIS) ,  a 
contract -management,  as  opposed  to  project -management,  database.  A 
second . database  was  considered  for  obtaining  the  requisite  sanq>le:  the 
Acquisition  Planning  and  Tracking  System  (APTS)  (recently  renamed  the 
Contract  Management  Network  (CMN) ) .  This  second  system  is,  in  the  main, 
a  project -management  dataUaase;  however,  it  is  only  a  few  years  old,  and 
the  contracts  resident  on  the  system  have  not  progressed  sufficiently  to 

e 

enable  an  accurate  measure  of  schedule  performance  to  be  obtained. 

Problems  Encountered.  Two  problems  were  encountered  with 
obtaining  a  listing  of  the  requisite  contracts  from  AMIS.  In  the  first 
instance,  AMIS  does  not  have  the  ability  to  differentiate  as  to  which 
phase  of  the  accpiisition  cycle  particular  contracts  relate;  hence,  it 
was  not  possible  (initially)  to  obtain  a  listing  of  only  design  and 
development  contracts.  In  the  second  instcuice,  AMIS  does  not  record 
whether  a  contract  employs  C/SCSC  or  C/SSR;  hence,  it  was  not  possible 
to  obtain  a  listing  of  contracts  which  excluded  those  contracts  that 
en^loyed  C/SCSC.  The  first  problem  eluded  resolution  for  some  time; 
however,  the  second  problem  was  addressed  immediately. 

Solution  to  the  Second  Problem.  To  overcome  the  second 
problem,  a  listing  was  obtained  of  contracts  below  the  C/SCSC  threshold: 
currently  $60  million  for  research,  development,  test,  euid  evaluation 
(ROT&E)  contracts,  and  $250  million  for  procurement  contracts  (in  fiscal 
year  1990  constant  dollars)  (DoDI  5000.2,  1991:11-8-2).  Initially,  only 


contracts  having  a  face  value  below  $60  million  dollars  were  obtained; 
however,  on  fvirther  investigation,  this  approach  was  found  to  exclude 
many  potentially  useful  contracts,  and  a  second  listing  was  obtained  of 
contracts  having  a  face  value  below  $200  million. 

Solution  to  the  First  Problem.  A  method  of  overcoming  the 
first  difficulty  was  not  discovered  until  late  in  the  data-collection 
process.  Contracts  which  involve  design  and  development  must  utilize 
RDT&E  funding  (i.e.,  '3600  money').  AMIS  records  the  utilization  of 
funding  by  Appropriation;  hence,  listings  were  able  to  be  obtained  of 
contracts  which  utilized  RDT&E  funding.  While  this  did  not  ensure  a 
100%  'hit  rate'  on  all  potential  contracts,  it  did  significantly  reduce 
the  data- search  requirements. 

Obtaining  Data  for  the  Independent  Variables 

Data  Sources.  With  the  exception  of  one  independent  variable 
(i.e.,  the  number  of  'POOOOOs'),  all  of  the  data  points  for  the 
independent  variables  were  obtained  from  primary  data  sources  (i.e.,  the 
contract  files) .  The  data  points  were  extracted  from  three  main 
contract -management  docmments,  namely: 

a .  the  Acquisition  Plan  (AP) , 

b.  the  Request  For  Proposal  (RFP) ,  euid 

c .  the  Contract . 

The  AP  provided  the  planning  variables,  while  the  RFP  provided  the 
specifying  and  evaluating  variables.  The  contract  was  used  to  provide 
the  contract  details  and  the  project  characteristics. 

Requisite  Sections  of  the  RFP.  A  number  of  sections  of  the 


RFP  were  required  for  the  data-collection  process,  including: 


a.  Section  L  -  Instructions  to  Offerors  (ITO) ; 

b.  Section  M  -  Evaluation  Factors  for  Award; 

c.  Statement  of  Work  (SOM) ; 

d.  Contract  Data  Requirements  List  (CDRL) ;  ^md 

e.  Specification. 

SQBlt.  The  CDRL  specifies  both  standard  and  modified 
(tailored)  Data  Item  Descriptions  (DIDs) .  The  modifications  to  the 
standard  DIDs  can  be  considerable.  To  assess  the  relevance  of  the  DIDs 
included  in  the  respective  CDRLs,  therefore,  121  DIDs  were  collected  and 
reviewed.  Of  these  121  DIDs,  the  DIDs  that  were  considered  relevant  to 
the  analysis  are  listed  at  Appendix  D. 

Difficulties  with  Obtaining  the  Rectuisite  Documents. 
Surprisingly,  for  a  great  number  of  contracts,  one  or  more  of  the 
requisite  documents,  or  sections  of  the  requisite  documents,  were 
missing  from  the  contract  files.  The  RFP  was  the  document  most  often 
missing  and,  typically,  the  same  reason  was  the  cause:  during  source 
selection,  the  RFP  was  stored  with  the  source- selection  files,  euid  a 
copy  was  not  placed  in  the  contract  files.  Source-selection  files  are 
destroyed  approximately  six  years  after  source  selection,  while  contract 
files  are  destroyed  approximately  six  years  after  the  contract  has  been 
closed.  Obviously,  there  could  be  many  years  difference  betmen  these 
two  dates.  This  practice  seems  to  have  occurred  most  often  for 
contracts  prior  to  1987;  the  Source  Selection  Office  has  advised  that 
this  practice  has  now  ceased.  For  the  purposes  of  this  research, 
however,  if  the  RFP  was  not  located  on  the  contract  file,  then  it  was 
generally  not  available  and  the  contract  was  not  able  to  be  measured. 


It  is  estimated  that,  had  the  requisite  documents  been  available,  the 
resultant  sample  size  could  have  been  more  than  doubled. 

BCPs/CCPs.  After  all  the  data  points  had  been  collected  for 
each  of  the  contracts,  a  listing  of  the  contract  modifications  (i.e.. 
the  'POOOOOs')  was  obtained  from  AMIS.  Initially,  the  intention  %irais  to 
investigate  which  'POOOOOs'  trere  likely  to  affect  schedule  perfomumce 
(e.g..  am  ECP  to  significantly  modify  the  developmental  item  is  likely 
to  affect  schedule  performance,  while  a  CCP  to  change  the  obligation 
amount  is  not) .  To  satisfactorily  determine  which  'POOOOOs'  were 
significant,  hovrever.  required  that  an  investigation  be  made  of  each 
contract  modification.  As  this  was  not  possible  within  the  available 
time,  the  total  number  of  'POOOOOs'  was  recorded  on  the  DCI.  as  of  the 
date  when  schedule  performance  was  measured.  For  contracts  where 
schedule  performance  was  not  able  to  be  measured  at  the  time  of  delivery 
of  the  major  developmental  item(s) .  either  an  earlier  milestone  date 
(e.g..  Critical  Design  Review  (CDR) )  or  a  projected  delivery  date  was 
used.  In  both  instances,  an  assessment  of  the  total  number  of  'POOOOOs' 
that  was  expected  to  occur  over  the  total  period  of  the  contract  was 
obtained  via  a  linear  scaling  technique  (i.e..  if  25  'POOOOOs'  were 
raised  in  the  first  half  of  the  contract,  then  50  'POOOOOs'  were  assiuned 
to  be  the  number  that  would  be  raised  for  the  total  contract) . 

Obtaining  Data  for  the  Dependent  Variable 

Data  Sources.  As  indicated  in  the  preceding  paragraph,  schedule 
performamce  was  generally  measured  at  the  time  of  delivery  of  the  major 
developmental  item(s) .  When  more  than  one  major  deliverable  was 
involved  and  the  delivery  information  was  available,  an  average  schedule 


performance  was  calculated.  As  delivery  information  was  not  available 
on  the  contract  files,  secondary  {e.g.,  AMIS)  and  other  primary  data 
sources  (e.g.,  the  Program  Manager)  were  used  to  obtain  this 
information.  A  number  of  difficulties  were  encountered  with  attempting 
to  obtain  schedule-performance  information,  particularly  from  AMIS. 

These  problems  are  described  in  the  following  paragraphs. 

Section  F  of  the  Contract.  Section  F  of  the  contract 
provides  a  list,  in  CLIN  sequence,  of  the  scheduled  delivery  dates.  In 
mamy  contracts,  the  block  in  which  to  place  this  information  was 
annotated:  As  Required  Herein  (ASREQ) .  In  the  descriptive  data  section 
that  accompanied  each  CLIN,  however,  specific  delivery  dates  were 
stated,  when  the  schedule  information  was  transferred  into  AMIS,  the 
ASREQ  annotation  was  transferred,  rather  than  the  specific  dates  or 
times.  In  many  instances,  this  precluded  using  AMIS  to  obtain  the 
planned- schedule  information. 

AMIS  History  Database.  After  a  contract  is  closed-out,  the 
AMIS  records  are  transferred  to  the  history  database.  This  database 
only  stores  the  information  originally  entered  into  the  active  datadsase 
when  the  contract  was  let  and  when  each  subsequent  'POOOOO'  was  raised. 
Any  subsequent  contract  actions  (e.g.,  delivery  of  items  against  a  CLIN) 
are  not  stored  and,  hence,  this  information  is  lost.  In  many  instamces, 
this  precluded  using  AMIS  to  obtain  actual  schedule  information. 

MOCAS.  AMIS  is  not  the  database  used  by  the  Administrative 
Contract  Officers  (ACOs)  during  administration  of  the  contract.  The 
ACOs  use  the  Mechanization  of  Contract  Administration  Services  (MOCAS) 
datal'ase,  which  tracks  planned  and  actual  schedule  for  all  items  under  a 
contract.  MOCAS  data  is  meant  to  lae  downloaded  into  AMIS  on  a  periodic 


basla;  however,  with  the  exception  of  the  Albuquerque  Office,  the 
do%mloading  of  data  appeared  to  be  sporadic.  A  second  difficulty  with 
the  use  of  MOCAS  for  this  research  was  that,  after  a  contract  has  been 
closed-out,  the  data  is  deleted  from  MOCAS.  This  precluded  using  MOCAS 
to  obtain  the  information  for  closed  contracts  that  was  not  available  on 
AMZS. 

Supplementing  AMTS,  Due  to  the  difficulties  associated  with 
AMIS,  schedule-performance  information  was  only  ^d>le  to  be  obtained  from 
AMZS  for  approximately  half  of  the  sanqple.  For  the  remaining  contracts, 
schedule-performance  information  was  obtained  from  the  buyer  or  from  the 
files  used  by  the  Program  Manager  (PM) .  DD250  forms  record  when 

deliverables  are  accepted  by  the  DoD,  and  these  forms  are  stored  on  the 
files  managed  by  the  PM.  Due  to  the  age  of  many  of  the  contracts  in  the 
sanq>le,  this  avenue  was  only  utilized  when  all  other  approaches  had 
failed. 

Contracts  Measured  Prior  to  Delivery.  Four  of  the  contracts 
included  in  the  sample  were  measured  prior  to  delivery  of  the 
developmental  item(s) .  Schedule  performance  for  three  of  these 
contracts  was  assessed  using  the  current  estimated  completion  date.  For 
each  of  these  three  contracts,  the  plaumed  schedule  delivery  date  had 
been  exceeded  and  greater  than  7S%  of  the  estimated  contract  period  had 
elapsed;  hence,  using  the  estimated  completion  date  was  not  perceived  to 
introduce  significant  errors.  The  foxirth  contract,  however,  was 
measured  at  CDR,  which  occurred  at  a  point  only  one -third  of  the  way 
thro\igh  the  contract.  To  obtain  a  reasonable  measure  of  schedule 
perf omumce ,  the  percentage  overrun  at  CDR  was  calculated,  as  well  as 
the  predicted  percentage  overrun  assuming  that  the  number  of  months  that 


th«  contract  was  currently  over-schedule  remained  constant.  An  average 
of  these  two  percentages  was  taken,  2md  this  was  used  as  the  measure  of 
schedule  performance.  In  all  four  cases,  the  number  of  'POOOOOs'  was 
scaled  upwards,  as  discussed  earlier. 

Discussion  of  Error  Sources. 

Few  errors  were  evident  in  the  primary  data  sources  because  the 
majority  of  data  being  obtained  was  specific  factual  information  (e.g., 
No/Yes  (0,1))  from  the  doounents  themselves.  Transcription  errors  may 
have  occurred  during  the  primary  data-collection  process;  however,  the 
likelihood  was  low  due  to  the  simplistic  nature  of  the  data.  Other 
errors  may  have  occurred  during  the  data-collection  process  Isecause  of 
the  interpretation  involved  with  some  of  the  independent  variables 
(e.g.,  ascertaining  which  DIDs  related  to  project  management) .  To 
prevent  errors  when  measiiring  these  data  points,  care  was  taken  when 
developing  the  operational  definitions  and  the  associated  DCI  to  ensure 
that  reliability  issues  (especially  equivalence)  auid  scoring  consistency 
were  adequately  addressed,  with  respect  to  the  secondary  data  sources, 
the  validity  of  the  data  was  occasionally  questionable.  Whenever  these 
concerns  arose,  the  s\ispect  data  was  checked  against  the  available 
primary  data  sources. 

Summary  of  the  Data  Collection 

This  section  of  this  chapter  has  described  the  actual  methods  used 
to  obtain  the  sample,  the  requisite  contractual  documents,  and  the 
measurement  of  the  independent  and  dependent  variables.  Furthermore,  a 
number  of  difficulties  associated  with  the  data  collection  were 
addressed,  in  the  hope  that,  through  an  explanation  of  these 


difficulties,  future  thesis  teams  could  avoid  similar  pitfalls  and 
disappointments.  The  next  section  of  this  chapter  addresses  the 
statistical  techniques  to  be  enqployed  to  answer  the  investigative  « 

questions . 


♦ 

General  Linear  Regression 


Introduction 

This  section  of  Chapter  111  provides  an  overview  of  general  linear 
regression  and  its  application  in  this  thesis.  Specifically,  this 
section  provides: 

a.  an  overview  of  general  linear  regression, 

b.  an  introduction  to  the  analysis  techniques  that  were  used  to 
initially  assess  the  data, 

c.  a  discussion  of  the  single- variable  auoalysis  techniques  that 
were  used  to  individually  assess  each  independent  variable, 

d.  a  description  of  the  multi-variable  analysis  techniques  that 
were  applied  to  build  the  requisite  multi-variedsle 
regression  models,  and 

e.  an  overview  of  the  techniques  that  were  used  to  assess  the 
aptness  of  the  models  built  in  the  preceding  step. 

Overview  of  Linear  Regression 

The  theory  of  general  linear  regression  is  widely  documented.  A 
good  reference  on  this  subject  is  the  Neter,  Hassermaui,  and  Kutner. 

(1989)  text  detailed  in  the  bibliography.  Much  of  the  background 
Information  provided  in  this  section  is  derived  from  Neter,  Wasserman 
and  Kutner. 
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A  regression  oiodel  formally  expresses  the  statistical  relation 
between  dependent  auid  independent  variables.  A  statistical  relation  is 
one  in  which  the  observations  do  not  fall  on  a  mathematically  defined 
functional  line;  that  is,  the  relation  is  not  perfectly  defined  by  a 
function.  The  two  essential  ingredients  of  a  statistical  relation  are 
that  the  dependent  variable  must  vary  systematically  with  the 
independent  variable (s),  and  that  there  must  be  a  scattering  of  points 
around  the  statistical  curve.  Regression  models  encapsulate  those 
ingredients  by  postulating  that  the  dependent  variedsle  has  a  probability 
distribution  for  each  level  of  the  independent  variable (s),  and  that  the 
means  of  those  probability  distributions  vary  in  a  systematic  manner 
with  the  independent  variable (s). 

Regression  models  with  one  dependent  variable  and  one  independent 
variable  are  called  simple  regression  models;  within  this  thesis,  the 
term  single-variable  analysis  is  used  to  describe  the  analysis  of  simple 
regression  models.  Regression  models  with  more  th«ui  one  independent 
variedile  are  called  multiple  regression  models;  this  thesis  used 
multiple  regression  modeling  to  emalyze  the  data  set.  As  a  number  of 
different  regression  techniques  were  utilized,  the  general  term,  multi- 
variad>le  analysis,  was  used  to  group  these  techniques  under  a  single 
heading.  Note  that  analysis  of  variance  (ANOVA)  models  are  also  known 
as  regression  models  (Neter,  Hasserman,  and  Kutner,  1989:363) .  No 
matter  how  many  independent  variedsles  may  exist,  single -variable 
regression  analysis  is  an  important  step  in  gaining  am  imderstanding  of 
the  potential  variad>le  relationships  within  the  data  set,  amd  in 
building  a  meamingful  multiple  regression  model  (Hosmer  amd  Lemeshow, 


In  all  regression  modeling,  the  aim  is  to  find  the  best-fitting, 
yet  most  parsimonious  and  meaningful,  final  model  that  provides  an 
acceptable  measure  of  the  relationship  between  the  dependent  variable (s) 
and  the  independent  variables  (Neter,  Wasserman,  and  Kutner,  1989:436; 
Hosmer  and  Lemeshow,  1989:82-83).  Therein  lies  the  challenge  of 
regression  modeling,  as  the  aim  is  often  at  odds  with  the  statistical 
ability  supported  by  the  data  set.  Statistical  techniques  allow  the 
modeler  to  mathematically  analyze  the  data  set  to  determine  the  best 
fitting  regression  model  within  stated  requirements. 

Now  that  am  overview  of  general  linear  regression  has  been 
provided,  the  remainder  of  this  section  is  devoted  to  addressing  the 
specifics  of  the  analysis  methodology  for  this  research. 

Initial  Data  Assessment 

The  first  step  in  the  initial  data  assessment  was  to  study  the 
data  using  a  range  of  data -presentation  techniques  such  as  histograms, 
scatter  plots,  box-euid-whis)cer  plots,  and  frequency  distributions,  in 
combination  with  descriptive  statistic  values  such  as  meaui,  median, 
mode,  stamdard  deviation,  and  skewness  were  utilized  for  this 
assessment.  The  Statistix  4.0  soft«rare  was  used  to  perform  this  first 
step  of  the  initial  data  assessment  (Analytical  Software,  1992) .  This 
initial  screening  enabled  some  variables  to  be  immediately  excluded  from 
fxurther  use  in  the  analysis  (e.g.,  where  there  was  little  to  no 
variaibility  across  the  sample  or  where  two  variables  encapsulated  the 
same  information)  (Neter,  Wasserman,  and  Kutner,  1989:435). 

Furthermore,  for  categorical -level  independent  variables,  the  initial 
screening  enadoled  low  auid  zero  cell  counts  to  be  identified,  where  it 


nuide  sense  to  do  so,  categories  were  collapsed  to  remove  the  low  euid 
zero  cell  counts  (Agresti,  1990:247) .  The  initial  screening  of  the 
data,  therefore,  encUsled  a  number  of  independent  variables  to  be 
eliminated  and,  for  categorical -level  variables,  enabled  the 
appropriateness  of  the  categorization  to  be  assessed.  After  this 
initial  assessment  had  been  completed,  the  reduced  set  of  independent 
varicdsles  was  ^d>le  to  be  studied  further  using  the  single-varisdile- 
auialysis  technicjues  described  in  the  next  section. 

Single-variable  Analyses 

After  the  initial  assessment  of  the  data,  a  single-variable 
analysis  of  each  independent  variable  with  respect  to  the  dependent 
variable  was  undertaken.  Due  to  the  formula  used  to  calculate  schedule 
performance,  the  dependent  variable  was  a  ratio- level  measure.  The 
single-variable  analyses  provided  a  measure  of  the  relative  statistical 
strength  of  each  independent -variable  to  dependent -variable 
relationship,  in  isolation  from  other  independent  variadsles. 

Based  on  the  results  of  the  single- variedsle  cmalyses,  each 
independent  variable  was  acknowledged  as  either  potentially  useful  in  a 
multiple  regression  model,  or  likely  to  play  no  role  in  a  multiple 
regression  model.  At  this  stage  of  the  cuialysis,  however,  independent 
variables  were  not  discarded  entirely  unless  the  relationship  was 
blatantly  poor,  as  varieUsle  interactions  remained  to  be  assessed  (Hosmer 
auid  Lemeshow,  1989:86).  Hosmer  and  Lemeshow  recommend  that  a  broad 
level  of  significance  (e.g.,  a>0.25)  should  be  utilized  at  the  single¬ 
variable  analysis  stage  to  ensure  that  important  varied>les  are  not 
overlooked  (Hosmer  and  Lemeshow,  1989:86) .  For  this  research,  the 


reconnnended  level  of  significance  (i.e.,  aaO.25)  was  utilized  at  the 
single-variable  analysis  stage. 

Different  analytical  techniques  were  utilized  for  each  different 
variable  type:  continuous  or  categorical.  The  following  sections 
discuss  those  analytical  techniques  and  provide  justification  for  the 
techniques  employed. 

Continuotis  Variables.  A  simple  linear  regression  (SLR)  model  was 
considered  to  be  appropriate  for  assessing  the  relationship  between  a 
continuous  independent  variable  amd  the  dependent  variadsle  (Neter, 
Hasserman,  2uid  Kutner,  1989:52) .  This  model  assumes  that  the  error 
terms  are  normally  distributed  with  a  mean  of  zero  and  constant 
variauice,  as  well  as  having  uncorrelated  error  terms.  Violations  of 
these  assumptions  was  not  considered  to  be  of  great  concern  at  this 
single-variable  analysis  stage,  due  to  the  broad  level  of  significance 
(i.e.,  a)  used  to  classify  the  degree  of  the  statistical  relationship 
(Neter,  Wasserman,  and  Kutner,  1989:73,  436) .  A  two-sided  t  test  with 
cui  a  of  0.25  was  used  to  test  the  null  hypothesis  that  the  estimated 
coefficient  of  the  independent  variable  was  equal  to  zero,  versus  the 
alternate  hypothesis  that  the  estimated  coefficient  of  the  independent 
variable  was  not  equal  to  zero  (Neter,  Wasserman,  euid  Kutner, 

1989:69-71)  .  The  outcome  of  the  test  provided  guidwce  as  to  whether  or 
not  each  variable  was  likely  to  play  a  role  in  the  multiple  regression 
model -building  process. 

For  each  ratio-level  independent  variable,  a  poor  or  non-linear 
relationship  was  examined  to  ascertain  whether  an  improved  fit  could  be 
obtained  by  the  use  of  a  data  transformation,  such  as  a  logarithm  or  eui 
exponent,  or  through  recategorization  into  an  ordinal -level  or  a  binary- 


level  variable  (Neter,  Wasserman,  euid  KuCner,  1989:435,  377-378)  .  Where 


the  transformation  resulted  in  a  categorical  variable,  the  techniques 
described  in  the  next  section  were  applicable. 

Categorical  Variables.  The  categorical  variables  in  this  research 
were  either  binary-level  or  ordinal-level  (i.e.,  more  than  two 
categories  in  a  hierarchical  order) .  Nonparametric  tests  were  utilized 
to  assess  the  relationship  between  the  categorical  variables  auid  the 
dependent  variable.  These  tests  were  enq>loyed  for  the  following 
reasons : 

a.  Due  to  the  exploratory  nature  of  the  research,  there  was  no 
justification  to  assvune  that  the  population  was  normally 
distributed. 

b.  Also  due  to  the  exploratory  nature  of  the  research,  an 
assunq}tlon  of  equality  of  variamce  between  categorized 
groups  of  the  dependent  variable  was  not  able  to  be 
justified. 

c.  Due  to  the  small  sample  size,  cell  counts  for  some  of  the 
categorical  variables  were  small.  This  meauit  that  it  was 
not  possible  to  Invoke  the  Central  Limit  Theorem  (CLT)  and 
ass\ime  that  the  means  of  the  individual  cells  were  normally 
distributed  (Devore,  1990:220). 

Generally,  nonparametric  procedures  lose  very  little  efficiency  against 
the  corresponding  normality  t  auid  F  tests  when  the  underlying 
distribution  is,  in  fact,  normally  distributed  (Devore,  1991:594) .  The 
specific  nonparametric  tests  that  were  used  for  each  data  type  are 
detailed  in  the  following  paragraphs.  The  Statistix  4.0  software 


3-33 


package  was  used  to  perform  these  single-variable  cmalyses  (Analytical 
Software,  1992) . 

Binary- level  Variables.  The  relationship  between  each 
binary- level  independent  variable  and  the  dependent  variable  was 
assessed  by  the  Mann-Whitney  (Wilcoxon)  Rank-Sum  test  (Devore,  1991:609- 
615;  Analytical  Software,  1992:116-118;  BMDP  Statistical  Software,  Inc., 
1992:616).  The  Mann-Whitney  (wilcoxon)  Rank-Sum  test  provides  a  test 
for  assessing  the  difference  in  means  between  two  groups  (i.e.,  the 
dependent  variable  categorized  by  the  binary  independent  variedsle) .  An 
assumption  of  the  Mann-Whitney  (Wilcoxon)  Rank- Sum  test  is  that  the 
underlying  distributions  are  of  the  same  shape  and  spread,  although  in 
common  practice  the  test  is  employed  without  regard  to  spread  (Devore, 
1991:610;  Analytical  Software,  1992:117).  The  null  hypothesis  for  this 
test  is  that  the  means  of  the  two  groups  are  equal,  versus  the  alternate 
hypothesis  that  the  means  of  the  two  groups  are  different.  This  test  is 
applicable  even  when  at  least  one  of  the  two  groups  is  small  emd  the 
underlying  distributions  are  quite  nonnormal  (Devore,  1991:609-610). 
Interestingly,  the  Mann-Whitney  (Wilcoxon)  Rank-Sum  test  does  not  suffer 
from  extreme  loss  of  efficiency  in  comparison  to  the  t  test  when  the 
underlying  distributions  are  normal,  yet  it  is  a  distinct  improvement  on 
the  t  test  for  nonnormality  applications  (Devore,  1991:615;  Analytical 
Software,  1992:116). 

As  the  Mann-Whitney  (Wilcoxon)  Rank-Sum  test  has  a  discrete 
probability  distribution,  an  exact  level  of  desired  significance  cannot 
always  be  achieved  (Devore,  1991:612).  At  this  stage  of  the  analysis, 
however,  this  limitation  was  not  considered  to  be  a  problem.  As  for  the 
continuous -level  variables,  a  significance  level  of  ar«0.25  was  used  in 


the  Maxin-Hhitney  (Wllcoxon)  Rank-Sura  test  to  provide  guidance  as  to 
whether  or  not  each  variable  was  likely  to  play  a  role  in  the  multiple 
regression  model -building  process. 

Ordinal -level  Variables.  The  relationship  between  each 
ordinal -level  independent  variable  and  the  dependent  variable  was 
assessed  by  the  one-«ray  Kruskal -Wallis  test,  a  nonparametric  ANOVA.  The 
Kruskal-Wallis  test  is  an  extension  of  the  Mann-Hhitney  (Hilcoxon)  Rank 
Slim  test  for  differences  in  group  meems  when  there  are  more  than  two 
groups,  and  en^loys  the  same  assumptions  (i.e.,  that  the  underlying 
distributions  are  of  the  same  shape  cmd  spread)  (Analytical  Software, 
1992:128;  BMDP  Statistical  Software,  Inc.,  1992:457,  616).  This  test  is 

e 

applicable  even  when  at  least  one  of  the  groups  is  small  euid  when  the 
\mderlying  distributions  are  quite  nonnormal  (Devore,  1991:623-624)  . 

The  null  hypothesis  for  this  test  is  that  the  means  of  all  the  groups 
are  equal,  versus  the  alternate  hypothesis  that  at  least  two  means  are 
different.  The  one-way  Kruskal-Wallis  test  statistic  is  approximately 
chi-square  distributed  for  a  minimum  group  size  of  six  (when  there  are 
only  three  groups)  or  of  five  (when  there  are  more  than  three  groups) 
(Devore,  1991:624;  BMDP  Statistical  Software,  Inc.,  1992:616).  As  for 
the  other  types  of  variables  discussed  above,  a  significance  level  of 
at>0.25  was  used  in  the  Kruskal-Wallis  test  to  help  provide  guidance  as 
to  whether  or  not  each  variable  was  likely  to  play  a  role  in  the 
multiple  regression  model -building  process. 

Suroroarv  of  Single- variable  Analyses.  This  section  has  addressed 
the  specific  single-variable-analysis  techniques  that  were  used  to 
assess  the  relationship  between  each  independent  variad>le  and  the 
dependent  variable.  Different  tests  were  employed  commensurate  with  the 


data  type.  A  broad  level  of  significajice  was  employed  for  these  tests 
to  ensvire  that  important  variables  were  not  overlooked  in  the  multi - 
variable  analyses. 

Multi -variable  Analyses 

The  expected  small  sanple  size  for  this  research  did  not  allow 
more  than  a  few  variables  to  be  meaningfully  fitted  in  a  multiple 
regression  model  (Neter,  Wassermaui,  and  Kutner,  1989:435).  In  essence, 
the  steps  leading  up  to  this  part  of  the  multiple  regression  model¬ 
building  strategy  were  necessary  to  erntble  the  examination  of  possible 
multi -variable  models  with  the  most  relevant,  most  statistically 
powerful,  yet  most  parsimonious  setf  of  independent  variables  supported 
by  the  data  set  (Neter,  Wasserman,  and  Kutner,  1989:436) . 

The  goal  of  this  research  is  to  identify  the  factors  which  affect 
schedule  performance,  not  to  develop  the  'one  best  model.'  For  this 
research,  therefore,  best  subsets  regression  was  considered  to  be  the 
most  appropriate  analysis  techniqnie  to  auiswer  the  investigative 
questions.  "With  this  procedure  a  number  of  models  containing  one,  two 
three,  and  so  on,  variables  are  examined  which  are  considered  the  'best 
according  to  some  specified  criteria"  (e.g.,  R’,  adjusted  R^,  or 
Mallows'  Cp)  (Hosmer  and  Lemeshow,  1989:87)  .  The  results  from  the  best 
subsets  regression  would  provide  a  number  of  models  of  approximately 
equal  explauoatory  power,  but  containing  different  variable  combinations 
The  software  available  to  perform  the  best  subsets  regression  (BMDP  amd 
Statistix  4.0),  however,  would  not  execute  with  the  full  variable  set. 
This  difficulty  precluded  using  best  subsets  regression  as  the  primary 
analysis  technique.  Instead,  a  stepwise  regression  approach  was 


enqployed  in  the  first  instance,  and  best  subsets  regression  was  used  to 
supplenwnt  the  information  obtained  through  the  stepwise  approach. 

The  small  sample  size  and  large  number  of  independent  variables 
precluded  the  use  of  any  backward  stepwise  multiple  regression  technique 
(Neter,  Nasserman,  emd  Kutner,  1989:437,  4S3;  Hosmer  and  Lemeshow, 
1989:106) .  Forward  stepwise  with  backward  elimination  multiple 
regression,  therefore,  was  the  method  selected  to  perform  the  multiple 
regression  modeling.  The  forward  stepwise  method  is  a  widely  practiced 
model  building  approach,  2uid  is  well  documented  (Neter,  Wasserman,  and 
Kutner,  1989:453-458;  Devore,  1991:548-550). 

The  forward  stepwise  with  backward  elimination  multiple  regression 
method  employs  a  step  procedure  to  examine  sequential  regression  models, 
commencing  with  a  model  containing  only  an  intercept  term  (Step  0) .  At 
each  successive  step,  an  independent  variable  is  added  to,  or  deleted 
from,  the  model.  Variable  addition  or  deletion  occurs  in  accordance 
with  user-defined  levels  of  a  specific  criterion  (commonly  termed  the 
enter  auid  remove  limits) .  The  specific  criterion  is  usually  the  error 
sum  of  squares  reduction,  the  coefficient  of  partial  correlation,  or  the 
F*  statistic  for  the  partial  F  test.  The  F*  statistic  for  the  partial 
F  test  is  probably  the  most  commonly  used  criterion  in  the  stepwise 
model -building  approach,  and  was  the  criterion  used  for  this  research 
(Neter,  Wasserman,  and  Kutner,  1989:241,453). 

The  partial  F  test  is  an  application  of  the  general  linear  test 
(Neter,  Wasserman,  and  Kutner,  1989:95,  241,  283) .  The  null  hypothesis 
being  tested  is  that  the  coefficient  of  the  variable  being  added  to  or 
excluded  from  the  model  is  equal  to  zero,  while  the  alternate  hypothesis 
is  that  the  coefficient  is  not  equal  to  zero  (Neter,  Wasserman,  and 


Kutner,  1989:283) .  A  value  of  the  test  statistic,  P*,  that  is  greater 
than  a  user-defined  critical  F  value  (obtained  from  the  F  distribution 
for  the  appropriate  degrees  of  freedom  auid  the  desired  level  of 
significance  (i.e.,  a))  leads  to  the  rejection  of  the  null  hypothesis; 
hence,  the  variadsle  is  included  in  the  model  (Meter,  Hasserman,  and 
Kutner,  1989:283). 

As  the  relationships  being  studied  have  not  been  well  researched, 
liberal  enter  and  remove  limits  were  employed  for  the  multiple 
regression  model -building  process  (Rosmer  and  Lemeshow,  1989:106,  108). 
A  significance  level  of  ot-O.OS  %rais  considered  to  be  too  restrictive  for 
the  partial  F  teat;  therefore,  an  0*0. l  was  used  to  obtain  a  balauice 
between  over- fitting  aad  under- fitting  the  multiple  regression  model 
(Meter,  Wasserman,  and  Kutner,  1989:453).  With  the  sample  size  of  25, 
an  a-0.1  approximately  relates  to  a  critical  F  value  of  three,  as  shown 
in  i^endlx  G.  The  liberal  enter  and  remove  limits  allowed  for  the 
IDcelihood  that  wealc,  yet  signific^Ult  and  meaningful  relationships,  were 
considered  in  the  model -building  process. 

Treatment  of  Ordinal -level  Variables.  In  a  regression  model, 
ordinal-level  varisUales  can  be  treated  in  one  of  two  ways:  firstly,  the 
ordinal  scale  can  be  assumed  to  be  based  on  a  Imown  xmderlying  interval 
scale;  and  secondly,  the  ordinal  scale  can  be  assumed  to  not  be  based  on 
a  ]mown  underlying  interval  scale  (Meter,  Hasserman,  and  Kutner, 
1989:376-377) .  In  the  first  case,  the  ordinal-level  variables  are 
treated  as  if  they  are  interval -level  variad^les  (with  the  appropriate 
scaling) ,  while  in  the  second  case,  the  ordinal -level  variables  are 
modelled  using  dummy  (binary)  variables  (Meter,  Hassemuui,  and  Kutner, 
1989:349-350) .  For  the  euialyses  conducted  for  this  research,  all 


ordinal -level  variables  were  recoded  into  dTimoy  variables.  This 
decision  was  taken  because  an  underlying  interval -scale  could  not 
reasonaibly  be  assumed,  given  the  exploratory  nature  of  the  research. 

When  am  ordinal -level  variable  is  coded  using  dummy  variables,  the 
result  is  to  create  one  less  variable  than  there  are  categories  in  the 
ordinal  scale  of  the  variable  (Heter,  Wasserman,  and  Kutner,  1989:360) . 
The  diimmy  variables  that  are  created  through  this  process  must  be 
treated  as  a  set;  that  is,  all  of  the  dtumiy  variables  must  be  entered 
in,  or  removed  from,  a  regression  model  together  (Hosmer  and  Lemeshow, 
1989:32)  .  The  requirement  to  treat  the  dxunmy  variatbles  as  sets  was  a 
limiting  factor  when  considering  the  choice  of  statistical  software. 

Statistical  Analysis  Tools.  Statistix  4.0  Analytical  Software 
(running  on  a  home  personal  computer)  and  the  BMDP  Release  7  Statistical 
Software  (running  on  the  AFIT  Hercules  mainframe  computer  system)  were 
the  two  software  packages  used  to  perform  all  the  statistical  analyses. 
Two  limitations  of  the  Statistix  4.0  stepwise  regression  procedure  are 
that: 

a.  the  software  cannot  model  duirniy  variables  as  sets;  and 

b.  the  software  does  not  allow  the  user  to  exercise  control 
over  the  multicollinearlty  exclusion-criterion  level 
(Analytical  Software,  1992:143-144) . 

The  BMDP  program  2R  for  performing  stepwise  regression,  on  the  other 
hand,  does  not  exhibit  these  limitations;  hence,  this  software  program 
was  used  to  conduct  the  stepwise  model -building  procedure  (BMDP 
Statistical  Software,  Inc.,  1992 :387>425) .  After  a  model  had  been 
obtained  from  the  stepwise  procedure,  Statistix  4.0  was  used  to  obtain 
diagnostics  and  graphical  plots. 


Multicollinearitv.  Multicollinearity  is  the  condition  which 
exists  when  there  is  correlation  between  independent  variables  in  a 
multiple  regression  model  (Neter,  Wasserman,  amd  Kutner,  1989:296; 
Devore,  1991:552)  .  Several  undesiraUsle  effects  occur  within  the  model 
if  the  independent  variables  display  multicollinearity;  however,  a  good 
multiple  regression  model  can  be  obtained  if  multicollinearity  is 
identified  amd  accounted  for,  either  in  the  model -building  process  or  in 
the  use  of  the  model  (Neter,  Hassermam,  and  Kutner,  1989:300-305,  411; 
Devore,  1991:552-553).  A  model -building  regression  procedure  must, 
therefore,  allow  for  the  possibility  of  variable  multicollinearity  at 
each  stage  of  the  amalysis,  so  that  potential  multicollinear 
relationships  cam  be  identified  amd  that  remedial  measures  cam  be  tadcen. 

The  variamce  inflation  factor  (VZF)  is  a  widely  used  method  for 
detecting  the  presence  of  multicollinearity  (Neter,  Wasserman,  amd 
Kutner,  1989:408) .  The  VIF  "measure [s]  how  much  the  variamces  of  the 
estimated  regression  coefficients  are  inflated  as  coit^ared  to  when  the 
independent  variad>les  are  not  linearly  related”  (Neter,  Wassermam,  amd 
Kutner,  1989:408) .  A  VIF  value  in  excess  of  10  is  commonly  used  as  am 
indication  that  multicollinearity  is  having  am  adverse  effect  on  the 
regression  model  (Neter,  Wassermam,  amd  Kutner,  1989:409;  Analytical 
Software,  1992:145;  Devore,  1991:552-553).  To  preclude  multicollinear 
variadsle  relationships  from  the  final  model,  this  research  en^loyed  a 
VIF  of  10  for  the  model -building  process.  Within  the  BMDP  2R  program, 
the  tolerance  commamd  (TOL> [value] )  is  used  to  set  the  VIF  level ;  a 
TOIi>0.1  commamd  equates  to  a  VIF  of  10  (BMDP  Statistical  Software,  Inc., 


The  approach  exercised  by  the  BMDP  2R  program,  through  the 
tolerance  level  comnand,  Is  that  of  excluding  independent  variables  from 
entering  a  stepwise  model  whenever  the  VIP  level  is  exceeded  (BMDP 
Statistical  Software,  Inc.,  1992:610-611).  Meter,  Wasserman,  and  Kutner 
ac)cnowledge  that  there  are  some  limitations  with  this  approach;  however, 
the  relative  advauitages  and  disadvantages,  in  comparison  with  other 
approaches,  were  not  regarded  as  severe  for  this  research  (Meter, 
Wasserman,  and  Kutner,  1989:411) . 

Interaction  of  Variadales.  Interaction  is  the  term  used  to 
describe  the  effect,  in  a  multiple  regression  model,  where  an  expected 
change  in  the  dependent  variable,  resulting  from  a  change  in  one 
independent  vari£d)le,  depends  on  the  value  of  euiother  independent 
variable  (Devore,  1991:528;  Meter,  Wasserman,  and  Kutner,  1989:232) .  To 
include  interaction  terms  in  the  model-building  process,  the  cross 
product  of  the  independent  variables  is  obtained,  thereby  creating  a  new 
variable  (Meter,  Wassemuui,  and  Kutner,  1989:355-356)  .  For  ordinal- 
level  varicdsles,  the  interaction  terms  were  created  from  the  raw  data, 
2uid  the  resultcuit  variables  were  then  recategorized  into  diunmy 
variables,  as  explained  earlier.  Within  this  research,  the  large  number 
of  independent  varieUsles  precluded  an  effective  study  of  all  possible 
two-way  or  three-way  interaction  terms.  Due  to  the  exploratory  nature 
of  this  research,  the  interaction  terms  that  were  included  in  the  model - 
building  process  were  derived  using  logical  considerations  only. 

Several  methods  exist  for  including  interaction  terms  in  the 
model -building  process.  The  first  method,  termed  hierarchical 
modelling,  assumes  that,  for  an  interaction  term  to  be  included  in  the 
model,  all  the  main  effect  terms  must  also  be  in  the  model  (Agresti, 


1990:144)  .  The  second  method,  termed  non-hierarchical  modelling, 
asstunee  that  the  inclusion  or  exclusion  o£  an  interaction  term  is 
independent  of  the  main  effect  terms  (Agresti,  1990:216) .  Due  to  the 
smell  sample  size,  this  research  used  a  non-hierarchical  model -building 
approach.  This  decision  %#as  considered  reasonable  for  a  number  of 
reasons,  which  were  that: 

a.  the  interaction  terms  included  in  the  model -building  process 
were  able  to  be  interpreted  from  a  stand-alone  perspective, 

b.  a  larger  number  of  interaction  terms  were  able  to  be 
studied,  and 

c.  a  larger  number  of  interaction  terms  were  able  to  be 
included  in  the  final  model. 

For  these  reasons,  a  non-hierarchical  model -building  approach  was 
believed  to  result  in  a  final  model  that  was  more  representative  of  the 
real  world,  where  mamagement  actions  are  known  to  be  interdependent. 

Assessment  of  Model  Aptness.  Analysis  of  the  possible 
relationships  under  study  did  not  end  with  the  regression  model 
resulting  from  the  stepwise  model -building  process.  Firstly,  the 
resultant  model  was  assessed  to  determine  whether  there  were  auiy 
important  departures  from  the  assumptions  associated  with  the  normal - 
error  regression  model.  Secondly,  diagnostics  were  used  to  assess 
whether  there  were  any  individual  cases  which  were  having  a  significeuit 
influence  on  the  coefficients  of  the  resultant  model .  The  following 
sections  will  describe  the  specific  techniques-  used  to  achieve  these 


objectives. 


Departures  from  the  Assuirotiona.  To  assess  amy  departures 
from  the  assun^tions  associated  with  the  normal-error  regression  model, 

* 

the  following  features  were  studied: 

a.  nonlinearity  in  the  regression  function ; 

*  b.  nonconstant  variance  of  the  error  terms; 

c.  nonindependence  of  the  error  terms; 

d.  good  model  fit,  except  for  a  few  outliers; 

e.  nonnormality  of  the  error  terms;  and 

f.  omission  of  some  important  independent  variables  from  the 
model  (Neter,  Wasserman,  and  Kutner,  1989:116) . 

These  features  are  described  in  the  following  sections. 

Nonlinearity  of  the  Regression  Function.  A  plot  of 
the  residuals  against  the  fitted  values  was  used  to  assess  for 
nonlinearity  of  the  regression  function.  This  plot  reveals  whether  the 
residuals  display  a  systematic  pattern  around  the  fitted  regression 
line;  a  good  regression  model  does  not  display  emy  significant  pattern 
(Neter,  Wasserman,  euid  Kutner,  1989:118,  247) . 

Nonconstancv  of  Error  Variemce.  The  residual  plot 
generated  for  the  previous  assessment  was  also  used  to  subjectively 
assess  for  euiy  indications  of  nonconstant  error  variance  (Neter, 
Wasserman,  and  Kutner,  1989:247) .  This  'visual'  approach  provided  only 
a  coarse  measure  for  this  assessment;  however,  this  was  considered  to  be 
f  satisfactory  given  the  nature  of  this  research. 

Nonindependence  of  Error  Terms.  Autocorrelation  is 
the  term  used  to  describe  the  situation  where  the  error  terms  in  a 

« 

regression  model  display  a  time -dependent  basis.  This  situation 
normally  arises  when  one  or  more  key  variables  have  been  omitted  from 
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the  model  (Neter,  Wasserman,  and  Kutner,  1989:484) .  For  this  research, 


autocorrelation  was  not  expected  to  be  significant  as  it  was  highly 
unlikely  that  the  contracts  measured  showed  time -dependency:  there  was 
no  reason  to  propose  that  the  particular  contracts  measured  were 
dependent  in  any  way.  Even  though  autocorrelation  was  not  expected,  the 
Durbin-Watson  test  was  performed  to  ensure  that  the  assun^tion  of 
independence  of  the  error  terms  was  supported. 

The  Durbin-Watson  test  for  autocorrelation  relies  on 
the  calculation  of  a  test  statistic  value,  D,  based  on  the  time-series 
order  of  the  error  terms  (Neter,  WassemieUi,  and  Kutner,  1989:491-492)  . 
This  was  easily  accommodated  within  the  final  regression  model,  as  the 
contracts  measured  were  arranged  in  contract -number  sequence  (a  de-facto 
time-series  arrangement  by  definition  of  contract  number) .  For  this 
test,  the  null  hypothesis  is  that  the  autocorrelation  parameter  is  equal 
to  zero,  whereas  the  alternate  hypothesis  is  that  the  autocorrelation 
parameter  is  not  equal  to  zero.  When  there  is  no  autocorrelation,  the 
Durbin-Watson  test  statistic  will  be  close  to  two;  however,  when 
positive  autocorrelation  is  present,  the  value  of  the  test  statistic 
will  be  close  to  zero,  and  when  negative  autocorrelation  is  present,  the 
value  of  the  test  statistic  will  be  close  to  four  (Analytical  Software, 
1992:146)  .  A  significance  level  of  cr«0.05  was  used  for  this  test. 

Presence  of  Outliers.  A  plot  of  the  steuidardized 
residuals  against  the  fitted  values  was  used  to  assess  for  the  presence 
of  outliers  of  the  dependent  varied^le  (Neter,  WassermcUi,  and  Kutner, 
1989:121,  247) .  Cases  where  the  standardized  residuals  were  more  ttuui 
three  standard  deviations  from  the  fitted  regression  line  were  flagged 
as  potential  outliers.  A  simple  probability  test,  utilizing  the 


prediction  interval,  was  used  to  assess  the  potential  outliers.  To 
perform  this  test,  a  new  regression  model  was  fitted  without  the 
outlier (s)  in  the  sample.  A  99.0%  prediction  interval,  associated  with 
each  outlier,  was  then  obtained.  If  the  measured  value  for  the  outlier 
was  outside  the  99.0%  prediction  interval,  then  this  result  was 
considered  to  support  a  hypothesis  that  the  outlier  had  come  from  a 
different  population  to  the  rest  of  the  sample  (Neter,  Wasserman,  and 
Kutner,  1989:130).  Outliers  were  not  excluded  from  the  sample  on  this 
basis  alone;  instead,  this  result  was  considered  in  combination  with  the 
result  from  the  influence  assessment  before  eui  exclusion  decision  was 
made. 

Nonnormalitv  of  Error  Terms.  A  normal  probability 
plot  of  the  residuals,  the  Wilk- Shapiro  Rankit  Plot,  was  used  to  assess 
for  nonnormality  of  the  error  terms  For  the  sample  sizes  of  25  and  23, 
and  at  a  level  of  significance  of  a«0.05,  the  critical  Wilk-Shapiro  test 
statistic  lower  limits  of  0.918  and  0.914,  respectively,  were 
appropriate  to  accept  or  reject  the  assumption  of  normality  for  the 
distribution  of  the  error  terms  (Conover,  1980:468). 

Omission  of  Important  Independent  Varietbles.  Due  to 
the  sample  size  limitations,  the  complexity  of  schedule  management,  5md 
the  significant  n\iinber  of  varicUsles  involved  in  the  analysis,  it  was 
highly  likely  that  important  independent  varicdjles  were  overlooked  at 
some  stage  of  the  methodology,  and  also  highly  unlikely  that  these 
omissions  were  detected.  The  single- varicdsle  euialyses  and  the  stepwise 
model -building  procedure,  employed  in  executing  this  research,  was 
expected  to  identify  all  important  variedjles  from  those  identified  for 


the  study. 


Identification  Of  Influential  Cases.  A  number  of  measures 


are  available  to  assess  the  possible  influence  of  cases  in  the  model; 
leverage  measure,  a  residual  measure,  and  a  combined  measure.  The 
leverage  measvire  assesses  the  influence  of  a  case  in  determining  the 
regression  coefficients;  however,  this  measure  only  considers  the 
effects  of  the  independent  variables  (Keter,  Wassernum,  and  Kutner, 
1989:392-397).  The  residual  meastire  assesses  the  influence  of  each 
observed  value  in  determining  the  regression  residuals;  however,  this 
measure  only  considers  the  effects  of  the  dependent  variable  (Neter, 
Wasserman,  auid  Kutner,  1989:398-400) .  A  combined  measure  considers  the 
effects  of  both  the  dependent  and  independent  variad}les  (Neter, 
Wasserman,  and  Kutner,  1989:401-408).  Given  the  goals  of  this  study  -- 
to  identify  factors  that  influence  schedule  performance  --a  combined 
measure  was  considered  to  be  the  most  relevant  diagnostic,  of  the  three 
discussed  here,  for  assessing  outliers  (BMDP  Statistical  Software,  Inc. 
1992:402;  Neter,  Wasserman,  and  Kutner,  1989:403-404) . 

The  combined  measure  that  was  used  to  assess  the  influence 
of  each  case  on  the  estimated  regression  coefficients  was  Cook's 
distance  (Neter,  Wasserman,  and  Kutner,  1989:403-404;  BMDP  Statistical 
Software,  Inc.,  1992:403).  While  this  measure  is  not  F  distributed,  a 
comparison  of  the  measxire  to  the  corresponding  F  distribution 
percentile-value  is  useful  for  interpreting  the  degree  of  influence  of 
each  case  in  the  model  (Neter,  Wasserman,  and  Kutner,  1989:403-404) . 
Neter,  Wassernum,  and  Kutner  state  that  a  Cook's  distance  with  a 
corresponding  F  distribution  percentile-value  of  "less  than  about  10  or 
20  percent"  has  little  apparent  Influence  on  the  regression 
coefficients,  while  percentile-values  "near  50  percent  or  more"  imply 


that  the  case  has  significant  influence  on  the  regression  coefficients 
(Neter,  Wassernan,  euid  Kutner,  1989:403) .  Based  on  this  recommendation. 


a  Cook's  distance  percentile-value  in  excess  of  20  percent  was 
considered  to  be  an  outlier  which  required  further  assessment.  Note 
that  this  measure  is  not  a  test  statistic;  hence,  there  is  not  a 
significance  level  (i.e.,  a)  associated  with  it. 

Statistix  4.0  was  used  to  provide  data  and  a  plot,  as 
necessary,  of  a  trusformation  of  the  Cook's  distance  associated  with 
each  case.  This  transformation  takes  into  account  the  sample  size  and 
the  number  of  independent  variables  in  the  model,  in  that  Statistix  4.0 
calculates  a  value  equal  to  one  minus  the  corresponding  F  distribution 
percentile-value  (Analytical  Software,  1992:152-153).  The  inplication 
of  this  calculation  is  that  outliers  are  identified  when  the  tramsformed 
Cook's  distance  is  less  than  O.a. 

As  stated  by  Neter,  Nasserman,  and  Kutner: 

[ . . . ]  an  outlying  influential  case  should  not  be  automatically 
discarded,  because  it  may  be  entirely  correct  and  simply 
represents  an  unlikely  event.  [...].  If,  on  the  other  hauid,  the 
circumstances  surrounding  the  data  provide  an  explauiation  of  the 
imusual  case  which  indicates  an  exceptional  sit\iation  not  to  be 
covered  by  the  model,  the  discarding  of  the  case  may  be 
appropriate.  (Neter,  Wasserman,  euid  Kutner,  1989:405-406) 

Using  this  logic,  the  final  decision  to  exclude  a  contract  from  the 

sample  was  based  on  a  subjective  assessment  of  that  contract,  amd 

whether  the  contract  represented  an  unusual  case. 

Summary  of  Model  Aptness  Assessment .  As  described  in  this 
section,  the  model  that  resulted  from  the  stepwise  model -building 
procedure  was  svibj acted  to  a  wide  range  of  aptness  assessments,  ranging 
from  an  investigation  of  any  departures  from  the  assvmptions  of  the 
normal -error  regression  model,  to  the  identification  auid  the  study  of 


influential  cases  in  the  model.  J^tness  assessment  was  a  vital  step  in 
verifying,  and  adjusting,  the  model  to  ensure  that  only  statistically 
supported  factors,  that  influence  schedule  performance,  «rere  identified. 

Beat  Subsets  Regression.  As  discussed  earlier  in  this  chapter, 
the  small  sample  size  precluded  using  best  avtbsets  regression  as  the 
primary  analysis  technique.  This  situation  arose  because  the  software 
programs  (i.e.,  ^(DP  9R  and  Statistix  4.0)  were  unable  to  execute 
correctly  with  the  small  sample  size  and  the  number  of  indepenitent 
variables  under  investigation.  Best  stibsets  regression,  however,  was 
able  to  be  used  to  supplement  the  information  obtained  through  the 
stepwise  regression  approach.  A  number  of  difficulties  with  the 
execution  of  best  subsets  regression  still  remained,  however,  amd  these 
difficulties  are  discussed  in  the  following  paragraphs. 

The  first  difficulty  with  the  best  subsets  approach  was  that 
neither  software  program  would  allow  the  ordinal- level  variables,  that 
had  been  recoded  into  dummy  variables,  to  be  entered  into  the  model  as 
sets.  Due  to  this  difficulty,  all  the  ordinal-level  variables  were 
recoded  into  binary- level  variables. 

The  recoding  of  the  ordinal -level  variables  into  binary- level 
variables  still  did  not  allow  BMDP  9R  to  execute  correctly.  Despite 
considerable  assistemce  from  BMDP  Technical  Support  Staff,  the 
difficulties  with  this  software  program  could  not  be  overcome. 

Statistix  4.0,  therefore,  was  used  to  conduct  the  best  subsets 
regression.  This  softnrare  has  some  additional  restrictions  which  are 
explained  in  the  following  paragraphs. 

Statistix  4.0  will  only  allow  20  unforced  variables  and  20  forced 
variables  to  be  T«sed  with  the  best  subsets  regression  program 


(Analytical  Software,  1992:164).  Furthermore,  this  program  is 
restricted  to  reporting  a  maximum  of  150  best  subsets  (Analytical 
Software,  1992:163) .  Due  to  these  two  restrictions,  the  prograun  cam 
only  produce  a  limited  number  of  best  sttbsets  for  each  subset  size.  For 
the  number  of  variaUsles  involved  in  this  amalysis,  these  restrictions 
meant  that  only  the  seven  best  subsets  could  be  obtained  at  each  subset 
size  for  any  one  run. 

To  overcome  the  restrictions  concerning  the  number  of  forced  and 
unforced  variables,  the  variadsle  set  was  reduced.  Firstly,  a  decision 
was  made  to  model  the  main  effects  only.  Secondly,  a  number  of 
variables  were  combined  as  interaction  terms  (i.e.,  the  cross  product 

e 

was  obtained)  .  Finally,  variadsles  which  were  found  to  liave  little 
significance  during  the  stepwise  regression  amalyses  were  dropped  from 
the  best  subsets  amalyses.  Using  these  techniques,  which  are  explained 
in  more  detail  in  Chapter  IV,  the  number  of  variad>les  used  for  these 
amalyses  was  reduced  to  20  unforced  variad»les  in  all  cases.  This 
restriction,  however,  did  not  prove  to  be  a  limitation,  as  the  results 
obtained  showed  that  further  best  subsets  would  not  contribute  to  the 
goalR  of  the  amalysis. 

The  best  subsets  algorithm  in  Statistix  4.0  analyzes  the  variadsle 
set  to  determine  ^he  best  subsets  based  on  the  adjusted  for  each 
model.  This  approach,  however,  may  result  in  a  number  of  models  which 
include  variaJales  which  are  not  significant.  To  ascertain  whether  this 
situation  had  occurred,  each  of  the  best  subsets  were  amalyzed  further 
using  the  linear  regression  program  in  Statistix  4.0  (Analytical 
Software,  1992:143-162).  The  p-value  associated  with  the  t  test  for 
each  of  the  variaUsles  in  each  of  the  models  amd  the  p-value  associated 


with  the  overall  F  test  for  each  of  the  models  were  obtained.  These 
results  were  then  amalyzed  to  determine  whether  the  variatbles  and  the 
models  were  significant  (a-0.1) .  A  study  of  aptness  was  not  conducted 
for  each  of  these  models,  because  this  degree  of  rigor  ms  not 
considered  to  be  necessary  given  the  limitations  of  the  best  subsets 
approach. 

The  best  sxibsets  regression  approach  enabled  a  nvunber  of  factors 
to  be  Identified  which  had  not  been  identified  through  the  stepwise 
regression  approach.  Despite  the  software  limitations,  the  use  of  the 
best  subsets  technique  was  considered  to  be  beneficial  amd  to  provide 
significant  additional  insights  into  the  nature  of  schedule  performance 

e 

and  schedule  management. 

Summary  of  General  Linear  Regression 

This  section  of  Chapter  III  has  provided  an  overview  of  general 
linear  regression  and  its  application  in  this  thesis.  Firstly,  the 
techniques  that  were  used  to  initially  assess  the  data  were  described. 
Secondly,  the  single-variable  analysis  techniques,  for  assessing  the 
relationship  between  each  of  the  independent  variables  auid  the  dependent 
variable,  were  discussed.  Following  this,  the  multi-varieUsle  analysis 
techniques  --  stepwise  regression  and  best  subsets  regression  --  were 
discussed.  Finally,  the  techniques  that  were  used  to  assess  the  aptness 
of  the  models  were  addressed. 

Operational  Definitions 

The  following  list  provides  the  operational  definitions  for  the 
terms  used  in  this  research: 
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a.  Acquisition  Contract.  An  acquisition  contract  vras  defined 
as  a  contract  which  was  executed  within  the  context  of  the 
DoD  acquisition  process  (i.e.,  using  phased  design  and 
development) . 

b.  fieheAile  Perf .  For  the  purposes  of  this  research, 
schedule  performance  tias  defined  as  the  percentage  overrun 
of  a  contract  from  its  target  period  of  performance.  In 
mathematical  terms,  schedule  performance  was  calculated  as 
follows : 

-  PPc 

SP  -  . *  100% 

PPc 

where : 

PPa  «  Performance  Period  (Actual) 

PPc  •  Performance  Period  (Contracted) 

Note  that  schedule  performance  can  be  negative  if  the 
contract  finishes  ahead  of  time. 

C!hap^i>r^  giimnuir-u- 

This  chapter  has  described  the  methodology  that  was  enqployed  to 
address  the  investigative  questions.  The  population,  sampling  frame, 
and  sample  were  described.  Furthermore,  justification  for  the 
representativeness  of  the  sample  was  also  provided.  Next,  the  data- 
collection  instrument  and  its  inplementation  were  described,  along  with 
the  data  collection  methodology  and  the  associated  problems.  A 
description  of,  and  justification  for,  the  statistical  techniques 
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follomd.  Including  details  o£  the  specific  tests  that  were  enqployed  and 
the  required  level  of  significance  for  each  test.  The  stage  has  now 
been  set  for  Chapter  IV  to  detail  the  data  analysis  amd  results,  and  for 
Chapter  V  to  detail  the  research  findings  emd  conclusions. 


ZV.  Findinaa  and  Armlvaia 


Introduction 

Tha  ralationahlpa  batween  tha  raaasured  pra- contract -award 
managmaant  actiona  by  tha  DoO  and  tha  raaultant  achadula  parformance 
wara  aaaaasad  using  tha  analyaia  tachniquaa  daacrlbad  In  tha  previous 
chapter.  This  chapter  will  present  the  results  obtained  through  the 
analyses,  thereby  setting  the  stage  for  the  conclusions  and 
recouBiendatlons . 

To  present  the  data  and  results  obtained,  this  chapter  will 
address  the  following  topics: 

a.  a  detailed  presentation  of  the  single- variadile  analyses; 

b.  a  detailed  presentation  of  the  multi -variable  amalyses;  and 

c.  a  discussion  of  the  results. 

With  respect  to  the  presentation  of  analyses,  it  Is  typical  for  these 
analyses  to  be  presented  from  the  perspective  of  each  of  the  research 
questions.  Given  the  nature  of  this  research,  however,  it  was  felt  more 
appropriate  to  first  describe  the  resiilts  for  each  of  the  analyses  and 
then  to  address  the  results  In  terms  of  the  specific  research  questions. 

Single-variable  Analyses 


Introduction 

This  section  of  Chapter  IV  will  address  the  slngle-variadsle 
analyses  for  all  of  the  Independent  variables.  As  discussed  in 
Chapter  III,  different  single- varlable-auialysls  techniques  will  be 


conducted  for  each  variable  type:  continuous  and  categorical. 


Specifically,  this  section  will  present: 

a.  em  introduction  to  the  variables  involved, 

b.  a  discussion  of  the  dependent  variable,  and 

c.  a  detailed  description  of  each  of  the  single- variad>le 
analyses  for  each  of  the  Independent  variables. 

Introduction  to  the  Variables 

Forty-one  variables  were  entered  into  a  data  set  after  the  data- 
collection  process  was  completed.  These  variables  are  listed  at 
i^pendix  B  along  with  the  raw  data  associated  with  each  of  these 
vari5U3les.  Not  all  of  these  variables  are  relevauit  to  the  analysis: 
contract  number  (CMO)  is  not  an  independent  variable,  and  the  face- value 
variables  (PVAliUEl  and  FVALnE2) ,  the  gross  domestic  product  deflator 
(GDPDBFL)  variable,  the  adjusted  face-value  variables  (FV87CDOL1  and 
FV87CDOI>2) ,  and  the  nximber  of  units  procured  (NOUNITS)  variable  are  all 
intermediate  variadiles  used  to  obtain  the  unit  cost  in  constant  dollars 
(UCXDSTCD)  variable . 

Dependent  Variable 

SCHEDPBR  and  SCHBDMOD.  The  schedule  performance  variedjle  was 
abbreviated  as  SCHEDPBR.  Schedule  performance  was  measured  as  the 
percentage  overmn;  hence,  a  negative  result  indicated  that  delivery  was 
achieved  ahead  of  schedule.  Schedule  performance  information  was  only 
able  to  be  obtained  for  25  of  the  29  contracts  measured.  A  histogram 
wd  box-and-whisker  plot  for  schedule  performance  is  presented  in 
Figure  4-1.  This  Figure  shows  that  there  are  two  outliers:  263%  and 
334%.  SCHEDPBR  was  modified  to  remove  the  two  outliers  and  was  renamed 


SCHBDMOD  to  reflect  this.  This  modification  was  done  to  more  fully 
investigate  the  effects  of  the  outMers,  emd  to  ensure  that  the 
statistical  emalyses  were  not  biased  due  to  the  inclusion  of  cases  that 
were  potentially  from  a  different  population.  To  facilitate  these 
goals,  both  the  single-variable  and  the  multi -variable  assessments  of 
the  independent  variables  %rare  conducted  using  both  SCHEDPER  and 
SCHBmOD.  (Note,  the  specific  characteristics  associated  with  the  two 
outliers  are  discussed  in  more  detail  later  in  this  chapter.) 

Descriptive  Statistics  for  SCHEDPER  and  SCHEDMOP.  The  descriptive 
statistics  for  SCHEDPER  auid  SCHEDMOD  are  provided  in  Ted>le  4-1.  These 
descriptive  statistics  show  that,  as  expected,  the  two  outliers  have  a 
significant  impact  on  the  mean,  standard  deviation,  and  steuidard  error. 
As  the  data  is  highly  skewed,  the  medieui  is,  perhaps,  a  better  measure 


Table  4-1.  Descriptive  Statistics  for  SCHEDPER  and  SCHEimOD 


STATISTIC 

SCHEDPER 

SCHEDMOD 

San^le  Size 

25 

23 

Mean 

70,768 

50.965 

Mediem 

39.4 

35.3 

Standard  Deviation 

81.811 

45.413 

Standard  Error 

16.362 

9.469 

Minimum 

-27.9 

-27.9 

Maximum 

334.0 

139.7 

Skewness 

1.8218 

0.4912 

of  central  tendency  (Devore,  1991:18}.  The  mediaui  values  for  both 
SCHEDPBR  and  SCHEDMOD  --  39.4%  and  35.3%,  respectively  are  not 
significantly  different  from  the  33%  mean  schedule  slippage  obtained  in 
the  most  recent  RAND  study  (Drezner  and  Smith,  1990:44) .  On  the  other 
hand,  the  mean  values  for  SCHBDP8R  and  SCHBDMDD  •-  70.77%  and  50.97%, 
respectively  --  are  considerably  different  from  the  findings  in  that 
study. 

Assessment  of  Normality  for  gfwgnpsp  mnA  srwmMnn  The  box-and- 
whisker  plot  of  SCHEDPER  in  Figure  4>2  indicated  that  an  assessment  of 
noirmality  for  the  underlying  population  of  schedule  performance  could 
not  be  made.  To  test  this  hypothesis  further,  Wilk-Shapiro  /  Rcuikit 
Plots  of  both  SCHEDPER  and  SCHEDMOD  were  obtained  from  Statistix  4.0. 
These  plots  are  given  in  Figure  4-2.  "Systematic  departure  from  a 
linear  trend  indicates  non-normality,  as  does  a  small  value  for  the 
Wilk-Shapiro  statistic"  (Analytical  Software,  1992:247).  The  Wilk- 
Shapiro  statistic  of  0.7901  for  SCHEDPER  showed  that  am  assessment  of 
normality  for  the  underlying  population  could  not  be  made  (a=0.05) 
(Conover,  1980:468).  If  it  were  assvuned,  however,  that  the  two  outliers 
removed  to  obtain  SCHETOIOD  were  atypical,  then  the  Wilk-Shapiro 
statistic  of  0.9465  for  that  variable  meant  that  an  assessment  of 
normality  could  be  made  (a>0.05)  (Conover,  1980:468) .  Given  that  the 
majority  of  the  independent  variables  in  this  study  were  categorical, 
and  the  single- variable  analyses  associated  with  these  variediles  were 
conducted  using  nonparametric  techniques,  further  assessment  of 
normality  at  this  stage  was  not  required. 
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Introduction .  In  this  section,  the  independent  variables  are 
discussed  in  the  order  in  which  they  appear  in  the  Data  Collection 
Instrument  (DCI) .  Frequency  distributions  for  each  categorical  variable 
are  reported  and  these  were  used  for  the  elimination  of  any  categorical 
variables  that  displayed  little  to  no  variation,  and  for  the  scaling  of 
ordinal-level  variables.  Following  this  initial  assessment,  results 
from  the  different  analyses  are  reported  and  an  assessment  was  made  as 
to  whether  or  not  a  relationship  existed  between  the  independent  and 
dependent  variables.  As  discussed  in  Chapter  III,  the  following  tests 
were  conducted: 

a.  ratio-level  data:  scatter  plots  auid  single  linear 
regressions  (SLRs) ; 

b.  ordinal-level  data:  Kruskal -Wallis  one-way  analysis  of 
variance  (ANOVA) ;  and 

c.  binary-level  data:  Mcum-Whitney  (Wilcoxon)  Rank-Sum  Test. 
The  results  of  the  nonparametric  tests  for  the  ordinal -level  euid  binary- 
level  variables  are  given  in  Table  4-2.  The  scatter  plots  for  the 
ratio-level  variables  are  given  at  Appendix  F,  while  the  results  from 
the  SIiRs  are  given  in  Table  4-3. 

Contract  Type  (CTYPE) .  The  Contract  Type  (CTYPE)  variable  was 
initially  scaled  as  an  ordinal-level  variable,  having  four  levels:  FFP, 
FPIF,  CPIF,  and  CPFF.  This  project -characteristic  variable  was  included 
in  the  analysis  to  moderate  for  the  different  degrees  of  risk  being 
shared  between  the  DoD  and  the  contractor.  A  frequency  distribution  of 
the  25  contracts,  for  which  schedule-performance  information  was 
obtained,  revealed  that  16  of  the  contracts  measured  were  FFP,  while 


Table  4-2.  Results  of  the  Nonparametric  Tests 


Variable  Naae 

and  Type 
(Binary, 

Ordinal) 

8CHBDPIR 

SCHWDMOP 

Xruskal- 

Wallis 

One-Way 

JUfOVB 

p-value 

Mann- 

Nhltney 

(Wlleoxon) 

Rank-Sun 

p-value 

1 

1 

Kruskal- 

Wallis 

One-Way 

AMOVA 
p -value 

Mann- 

Wbltney 

(Wlleoxon) 

Rank-Sun 

p-value 

CTYPB 

Bln 

N/A 

0.4447 

N/A 

0.7768 

D  DP 

Bin 

H/A 

0.2391 

N/A 

0.3815 

PRODOPT 

Bin 

N/A 

0.2330 

N/A 

0.4757 

PLPRESCH 

Bln 

N/A 

0.0096 

N/A 

0.0386 

PLAGGR 

Bin 

N/A 

0.6332 

N/A 

0.9110 

PLCONC 

Bin 

N/A 

0.9782 

N/A 

0.9753 

PLSRISK 

Ord 

0.2222 

N/A 

0.3223 

N/A 

PLTRISK 

Ord 

0.3421 

N/A 

0.8963 

N/A 

COMPIiEX 

Ord 

0.6994 

N/A 

0.1578 

N/A 

PLWBSDEV 

Bin 

N/A 

0.9746 

N/A 

0.1558 

PLWBSL3M 

Ord 

0.2718 

N/A 

0.0781 

N/A 

PLDRRFP 

Bin 

N/A 

0.1104 

N/A 

0.2087 

TECHDEFN 

Ord 

0.9518 

N/A 

0.7676 

N/A 

SOWDWBS 

Bin 

N/A 

0.7598 

N/A 

0.1647 

SOWCSSR 

Bin 

N/A 

0.7184 

N/A 

0.8768 

SOHSDXSP 

Bin 

N/A 

0.2147 

N/A 

0.8522 

SOHRCWP 

Bln 

N/A 

0.5886 

N/A 

0.8522 

SOHRCSP 

Bin 

N/A 

0.6034 

N/A 

0.7226 

SOWFRSI 

Bin 

N/A 

0.6456 

N/A 

0.8195 

EVSDZSP 

Bln 

N/A 

0.1627 

N/A 

0.0881 

EVRCHP 

Bin 

N/A 

0.9188 

N/A 

0.4410 

EVRCBP 

Bin 

N/A 

0.6304 

N/A 

0.4197 

eight  were  FPIF,  one  was  CPZF,  and  one  was  CPFF.  The  latter  two  types 
did  not  contain  a  sufficient  number  of  sanqples  to  warrant  retaining  them 
as  separate  entities;  hence,  the  FPIF,  CPXF,  wd  CPFF  categories  were 
combined  into  a  single  class.  CTYPB,  therefore,  was  rescaled  as  a 
dichotomous  variable  with  'FFP'  scaled  as  *0',  and  'Other  Than  FFP' 
scaled  as  'l' . 

The  results  from  the  Mazm-Hhitney  (Hilcoxon)  Rank-Sum  Test,  as 
reported  in  Table  4-2,  showed  that  CTYPB  was  not  significamtly  related 
to  either  SCHBDPBR  or  SCHBOMOD  (aBO.25) .  From  these  results,  CTYPB  was 
not  expected  to  be  a  significant  variable  in  the  multi-variable 
analyses;  however,  it  was  retained  in  the  data-set  to  enable  potential 
interactions  to  be  assessed. 

Development  /  Development  and  Production  (D  DP) .  The 
Development  /  Development  and  Production  (D_DP)  variable  was  a  project- 
characteristic  variable  which  was  included  in  the  euialysis  to  moderate 
for  contracts  which  included  a  production  element.  Of  the  25  contracts 
for  which  schedule-performouice  information  was  obtained,  the  frequency 
distribution  revealed  that  only  six  of  the  contracts  required  that 
production  items  be  manufactured  after  the  development  item(s)  had  been 
completed,  while  19  did  not.  The  results  from  the  Mzum-Whitney 
(Wilcoxon)  Reuik-Sum  Test,  however,  showed  that  D_DP  was  slightly  related 
to  SCHBDPBR  but  not  to  SCHETOIOD  (o>0.25) .  From  these  results  D_DP  was 
considered  to  be  a  significant  enough  variable  for  inclusion  in  the 
multi -variable  analyses. 

Production  Option  (PRODOPT) .  The  Production  Option  (PRODOPT) 
variable  was  a  project-characteristic  variable  which  was  included  in  the 
analysis  to  moderate  the  previous  variable  (D_DP)  for  contracts  which 
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included  production  requirements  as  an  option.  Of  the  25  contracts  for 
which  schedule-performance  information  was  obtained,  the  frequency 
distribution  for  the  Production  Option  (PRODOPT)  variadile  revealed  that 
15  contracts  in  the  sample  included  a  production  option,  while  ll  did 
not.  The  results  from  the  Mann-Nhitney  (Wilcoxon)  Rank-Sum  Test  showed 
that  PRODOPT  was  slightly  related  to  SCRBDPBR  but  not  to  SCHBDHOD 
(e(a0.25)  .  From  these  results,  however,  PRODOPT  «ras  considered  to  be  a 
significant  enough  variable  to  be  included  in  the  multi-variable 
analyses . 

number  of  Contract  Modifications  (IT  PS) .  The  Number  of  Contract 
Modifications  (NOBCPS)  variable  was  included  in  the  auialysis  as  a 
surrogate  variable  for  all  the  post-contract-award  management  actions 
which  may  intact  schedule  performance.  As  this  variedile  is  a  ratio- 
level  variable,  the  first  step  was  to  assess  the  relationships  between 
this  variable  and  SCHEDPER  /  SCHEI»40D  through  the  use  of  scatter  plots 
(refer  J^pendix  F)  .  The  results  from  these  auialyses  showed  that  there 
was  a  definite  relationship  between  NOECPS  euid  both  SCHEDPER  emd 
SCHEDMOD.  Following  this,  SLRs  were  conducted  to  obtain  the  degree  of 
significance  of  the  'visual'  relationships.  The  results  from  these 
tests  are  presented  in  Table  4-3,  and,  from  these  results,  this  variedsle 
was  considered  to  be  a  definite  candidate  for  the  multi-variable 
anal  rstes  (a-0.25)  . 

Pre-scheduled  (PLPRESCH) .  The  Pre- scheduled  (PLPRESCH)  variable 
was  included  in  the  analysis  to  captxure  whether  or  not  the  SPO  had 
mandated  a  schedule  requirement  in  the  RFP.  Of  the  25  contracts  for 
which  schedule-performance  information  was  obtained,  the  frequency 


distribution  for  the  this  variable  revealed  that  20  of  the  contracts  in 


Table  4-3.  Results  of  Simple  Lixiear  Regressions 


Variable  Name 

8CB1DPSR 

SOPBOMW) 

Simple  Linear 
Regression 
p -value 

Simple  Linear 
Regression 
p-value 

NOECPS 

0.0517 

0.0000 

DCOSTCD 

0.S913 

0.0651 

PAGESSOW 

0.2968 

0.4846 

NODIDS 

0.4692 

0.8154 

NOPMDIDS 

0.9267 

0.2557 

MOEVCRIT 

0.8038 

0.6415 

the  sample  were  pre-scheduled  by  the  SPO,  while  five  were  not.  The 
results  from  the  Mazm-Whitney  (Wilcoxon)  Rank-Sun  Test  sho«red  that 
PLPRBSCH  was  very  significantly  related  to  both  SCHEDPBR  and  SCHEDMOD 
(a«0.25).  From  these  results,  PLPRESCH  was  considered  to  be  a 
significant  variable  for  inclvislon  in  the  multi-variable  analyses. 

Aggressive  (PLAGGR) .  The  Aggressive  (PLAGGR)  variaUsle  was 
included  in  the  cuoalysis  to  capture  whether  or  not  the  SPO  considered 
the  schedule  to  be  aggressive.  Of  the  25  contracts  for  which  schedule- 
performance  Information  was  obtained,  the  frequency  distribution  for 
this  variable  revealed  that  only  six  of  the  contracts  in  the  sample  were 
considered  by  the  SPO  to  Involve  an  aggressive  schedule,  while  19  were 
not.  The  results  from  the  Mann-Nhitney  (Wilcoxon)  Rank-Sum  Test  showed 
that  PZiAOGR  was  not  significantly  related  to  either  SCHEDPER  or  to 
SCHEDMOD  (a>0.25) .  From  these  results,  PLAGGR  was  not  expected  to  be  a 
significant  variable  in  the  multi -variable  analyses;  however,  it  was 


retained  In  tha  data-sat  to  enable  potential  interactions  to  be 

assessed. 

Coneurrangy  fPLCOWC) .  The  Concurrency  (PLCONC)  variable  was 
included  in  the  analysis  to  capture  whether  or  not  a  schedule  involved 
concurrency.  Of  the  25  contracts  for  which  schedule -performance 
information  was  obtained,  the  frequency  distribution  for  this  variable 
revealed  that  11  contracts  in  the  sample  involved  some  degree  of 
concurrency,  while  14  did  not.  Contrary  to  expectations,  however,  the 
results  from  the  Mann-Whitney  (Wilcoxon)  Ranlc-Sum  Test  showed  that 
PLCONC  was  not  significantly  related  to  either  SCHEDPBR  or  to  SCUEDMOD 
(a>0.2S)  .  From  these  results,  PLCONC  was  not  ejected  to  be  a 
significant  variable  in  the  multi-variable  analyses;  however,  it  was 
retained  in  the  data-set  to  enable  potential  interactions  to  be 
assessed. 

Sources  of  Supply.  For  the  reasons  given  in  Chapter  III,  the 
Sources  of  Supply  variable  was  deleted  from  the  research  effort  shortly 
after  the  data-collection  was  begun. 

Planned  Contract  Type.  A  comparison  between  what  was  planned  for 
the  contract  type  and  tdiat  was  actually  done  (CTYPB)  revealed  that  there 
was  no  difference  between  the  planned  and  actual  contract  types;  hence, 
this  variable  was  dropped  from  the  analysis. 

Schedule  Risk  (PLSRISK) .  The  Schedule  Risk  (PLSRISK)  variable  was 
Included  in  the  analysis  to  capture  the  Program  Manager's  assessment  of 
the  schedule  risk  associated  with  the  selected  acquisition  strategy.  Of 
the  25  contracts  for  which  schedule-performance  information  was 
obtained,  the  frequency  distribution  of  this  variable  revealed  that 
eight  contracts  %fere  rated  as  having  low  schedule  risk,  three  as  having 
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low'BMdiuin  risk,  13  as  having  moderate  risk,  zero  as  having  mediun-high 
risk,  and  one  as  having  as  high  risk.  (Note,  one  contract,  for  which 

* 

schedule -performance  information  ms  not  able  to  be  obtained  was  rated 
as  having  a  medium- high  schedule  risk.)  Due  to  these  sample 
*  limitations,  the  'medium- high'  and  'high'  categories  were  combined  with 

the  'medium'  category.  Under  this  recategorization,  the  frequency 
distribution  for  PI,SRZSK  ms: 

a.  low  schedule  risk  (category  '1'):  8; 

b.  low-medium  schedule  risk  (category  '2'):  3;  and 

c.  higher  than  low-medium  schedule  risk  (category  '3') :  14. 

The  results  from  the  Kruskal -Wallis  One-Way  AMOVA  Test  shomd  that 
PLSRISK  ms  slightly  related  to  SCHEDPBR  but  not  to  SCHEDMOD  (a-0.25) . 
From  these  results,  PLSRISK  ms  considered  to  be  a  significant  enough 
variable  for  inclusion  in  the  imiltl-variable  analyses. 

Taffhnicial  Risk  (PLTRISK) .  The  Technical  Risk  (PLTRISK)  variable 
ms  included  in  the  analysis  to  capture  the  Program  Manager's  assessment 
of  the  technical  risk  associated  with  a  particular  acquisition.  Of  the 
25  contracts  for  which  schedule-performance  information  ms  obtained, 
the  frequency  distribution  of  this  variable  revealed  that  nine  contracts 
mre  rated  as  having  low  technical  risk,  four  as  having  low-medixim  risk, 
12  as  having  moderate  risk,  zero  as  having  medium-high  risk,  and  zero  as 
having  as  high  risk.  The  frequency  distribution  for  the  three  levels  of 
h  PLTRISK  ms: 

a.  low  technical  risk  (category  '1'):  9; 

b.  low-medium  technical  risk  (category  '2'):  4;  and 

k 

c.  medium  technical  risk  (category  '3'):  12. 
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The  results  from  the  Kruslcal-Nallls  One-May  AMOVA  Test  showed  that 


PLTRISK  was  not  significantly  related  to  either  SCHBDPBR  or  to  SCHBDNOD 
(a«0.25) .  From  these  results,  PLTRISK  «ras  not  expected  to  be  a 
significant  variable  in  the  multi- variable  analyses;  however,  it  was 
retained  in  the  data-set  to  enable  potential  interactimis  to  be  assessed 
(e.g.,  PhTRISK  and  PLSRZSK) . 

Ohit  Coat  in  rnn«t-«nt^  Dollars  (DPOflTm^  «nd  Complexity  (complbx^ 


Three  sxib-variables  were  measured  in  an  attenpt  to  obtain  a  measure  of 
conqplexity  (OOMPLEX) :  Ohit  Coat  in  Constant  Dollars  (UCOSTCD) ,  Number 
of  Pages  in  the  SON  (PAOBSSON) ,  and  total  Number  of  DZOs  (NODZDS) .  The 
conplexity  variable  %ma  included  in  the  luialysis  as  a  moderator  variable 
to  capture  the  potential  inpact  of  increasing  complexity  on  schedule 
performance.  The  Intention  behind  measuring  these  three  sub- variables 
was  to  combine  them  into  a  single  measure  of  complexity.  During  data 
collection,  however,  only  tKX}STCD  appeared  to  bear  any  resemblance  to  a 
subjective  assessment  of  the  complexity  of  individual  contracts.  With 
respect  to  the  other  two  variables  --  PA6BSS0W  and  NODZDS  --a  scatter 
plot  revealed  that,  as  expected,  a  relationship  existed  between  the 
length  of  the  SOW  and  the  ntunber  of  DZDs  (refer  ippendix  F)  .  Any 
relationship  to  the  subjective  assessment  of  conplexity,  however,  did 
not  exist.  Possible  explanations  for  this  result  were  that  any 
potential  relationships  were  nullified  over  time  due  to  turnover  of  SPO 
personnel,  different  enphases  within  individual  SPOs,  and/or  the  many 
changes  that  have  been  made  to  acquisition  policies  auid  procedures  in 
the  period  from  1976  to  1991. 

With  regard  to  UCOSTCD,  a  histogram  showing  the  spread  of  unit 
costs  is  presented  in  Figure  4-3.  From  this  histogram  and  from  a 


Figure  4-3.  Hlatogram  of  UCX3STC3) 

sxibjectlve  evalxiation  of  the  contracts  in  the  sample,  the  following 
decision  rule  was  used  to  convert  UCOSTCD  into  a  three-level  ordinal 
variable  (COMPLEX) : 

a.  UCOSTCD  <-  .$4,000,000:  COMPLEX  -  1; 

b.  UCOSTCD  >  $4,000,000  but  <-  $14,000,000:  COMPLEX  -  2; 

C.  UCOSTCD  >  $14,000,000:  COMPLEX  -  3. 

Of  the  25  contracts  for  «rfaich  schedule-performance  information  was 
obtained,  the  frequency  distribution  for  COMPLEX  revealed  that  seven 
»  contracts  were  rated  as  being  of  low  complexity,  12  as  being  of  moderate 

complexity,  and  six  as  being  of  high  complexity. 

The  scatter  plots  for  UCOSTCD  (refer  Appendix  F)  revealed  that 

k 

there  was  almost  no  relationship  between  UCOSTCD  and  SCHEDPER;  however, 
a  slight  relationship  existed  between  UCOSTCD  and  SCHEimOD.  The 


p- values  from  the  SLRs,  as  presented  In  Table  4-3,  confirmed  this 
'visvial'  evaluation  (a«0.25) .  The  same  relationships  were  obtained  for 
COMPLEX  using  the  Kruskal -Wallis  One-Way  ANOVA  test  (a«0.25) .  From 
these  results,  both  UCOSTCD  and  COMPLEX  were  considered  to  be 
significant  enough  variables  for  inclusion  in  the  multi-varied)le 
analyses  (thoxigh  not  together)  . 

with  respect  to  the  other  t«ro  variables  under  the  heading  of 
complexity  --  PAQESSOW  and  MODIDS  --  these  two  variables  «rere  analyzed 
with  respect  to  SCHEDPER  and  SCHEmOD  to  ascertain  whether  a 
relationship  might  exist.  The  scatter  plots  in  Appendix  F,  and  the 
results  from  the  SLRs  in  Table  4-3,  revealed  that  no  relationships 
existed  between  PAGESSOW  and  either  SCHEDPER  or  SCHEDMOD,  nor  between 
NOOIDS  amd  either  SCHEDPER  or  SCHEDMOD  (a-0.25) .  From  these  results, 
neither  PAGESSOW  nor  NODIDS  were  expected  to  be  significamt  variables  in 
the  multi -variable  analyses;  however,  they  were  retained  in  the  data-set 
to  enable  potential  interactions  to  be  assessed. 

Work  Breakdown  Structure  (WBS) .  Three  sub- variables  were  measured 
with  respect  to  the  preliminary  WBS  in  an  attenqpt  to  measure  the  degree 
of  planning  thoroughness  for  each  contract:  Preliminary  WBS  Developed 
(PLWBSDEV) ,  Number  of  Elements  at  Level  Three  of  the  WBS  (PLWBSL3) ,  and 
the  Lowest  Level  Developed  of  the  WBS  (PLWBSLL) .  The  intention,  at  the 
time  that  the  DCI  was  formulated,  was  to  combine  these  three  sub¬ 
variables  into  an  overall  measure  of  plaiming  thoroughness.  Having 
collected  the  data,  however,  a  reasonable  method  for  achieving  this 
overall  measure  could  not  be  readily  determined;  therefore,  the  three 
variables  were  assessed  indlvidxially. 


A  difficulty  with  assessing  these  three  variedsles  was  caused  by 
structural  zeros  (Agresti,-  1990:244) .  For  contracts  where  a  preliminary 
:<BS  had  not  been  developed  (i.e.,  PLHBSOBV  -  0),  PLWBSL3  amd  PLWBSLL 
could  only  be  scored  with  a  zero.  This  resxilt  occurred  for  six  of  the 
25  contracts  for  tdiich  schedule-performance  information  had  been 
obtained.  The  other  19  contracts  in  the  sample  had  developed  a 
preliminary  WBS.  As  a  result  of  the  structural  zeros,  however,  the 
information  contained  in  PLWBSDEV  urns  also  contained  in  PLWBSLL; 
PLNBSDEV,  therefore,  was  eliminated  from  the  analysis.  (Note,  the 
information  provided  by  PLNBSDEV  ma  not  also  contained  in  PLHBSL3 
because  a  WBS  that  had  only  been  developed  to  level  two  would  cause 

e 

PLWBSL3  to  be  scored  with  a  zero.) 

PLWBSL3 .  The  scatter  plots  for  the  Number  of  Elements  at 
Level  Three  of  the  WBS  (PLWBSL3)  variable  (refer  Appendix  F)  showed  tiiat 
only  a  very  slight  relationship  existed  between  PLWBSL3  and  both 
SCHEDPER  euid  SCHEDMOD.  Schedule  overrun  did  appear  to  be  reduced  as  the 
nvimber  of  elements  at  level  three  was  increased;  however,  the  outliers 
in  both  scatter  plots  appeared  to  be  highly  influential.  In  an  attempt 
to  overcome  this,  a  number  of  tr^ulsfonnations  of  PLWBSL3  were 
investigated.  The  only  transformation  which  resulted  in  am  appreciad>le 
improvement  in  the  statistical  relationship  was  obtained  by  converting 
PLWBSL3  to  a  four- level  ordinal  variable  (PLWBSL3M)  based  on  its 
quartiles:  0,  10,  amd  16.  The  results  from  the  Kruslcal -Wallis  One-Way 

ANOVA  Test  showed  that  PLWBSL3M  was  signif icamtly  related  to  SCHEDMOD 
but  not  to  SCHEDPER  (a>0.25) .  From  these  results,  the  tramsformed 
variad}le,  PLWBSL3M,  was  considered  to  be  a  signif icamt  enough  variable 
for  inclxision  in  the  multi-variad>le  amalyses. 


PT.msT.T.  'nie  scatter  plots  for  the  Lowest  Level  Developed 
of  the  MBS  (PLNBSLL)  variable  shoirad  that  only  a  very  slight 
relationship  existed  between  PLNBSLL  and  both  SCHEDPER  and  SCHEDMOD. 
Fiirthermore,  these  scatter  plots  indicated  that  transforming  PLNBSLL 
from  a  ratio- level  variable  to  an  ordinal- level  variable  may  be  more 
appropriate.  A  number  of  different  transformations  were  attempted, 
including  transforming  to  foxir-level,  three- level,  and  binary.- level 
variables.  Only  one  transformation  produced  a  significant  result  from 
either  the  Kruskal-Nallis  One-Nay  AMOVA  Test  or  the  Mann-Nhitney 
(Nllcoxon)  Rank-Sum  Test  (o(«0.2S).  Interestingly,  this  tremsformation 
resulted  in  a  binary- level  variable  that  «ras  structvirally  identical  to 

a 

the  Preliminary  NBS  Developed  (PLNBSDEV)  variable  (i.e.,  contracts  that 
were  scored  with  either  a  '0'  or  a  '1'  imder  the  transformation  had  the 
identical  score  under  PLNBSDEV) .  For  this  reason,  the  previous  decision 
to  eliminate  PLNBSDEV  was  reversed,  and  PLNBSLL  was  eliminated  from  the 
multi -variable  analyses.  For  PLNBSDEV,  the  results  from  the  Mann- 
Nhitney  (Nllcoxon)  Rank-Sum  Test  showed  that  this  variable  was  not 
significcuitly  related  to  SCHEDPER  but  was  related  to  SCHEDMOD  (a-0.25) . 
From  these  results,  PLNBSDEV  was  considered  to  be  a  significant  enough 
variable  for  inclusion  in  the  multi -variable  analyses. 

Draft  RFP  (PLDRRFP) .  The  Draft  RFP  (PLDRRFP)  variable  was 
included  in  the  analysis  to  capture  whether  or  not  a  draft  RFP  had  been 
issued.  Of  the  25  contracts  for  which  schedule -performance  information 
was  obtained,  the  frequency  distribution  for  this  variable  revealed  that 
five  contracts  in  the  sample  had  not  issued  a  draft  RFP  prior  to  formal 
solicitation,  whereas  20  had.  The  results  from  the  Mann-Nhitney 
(Nllcoxon)  Ramk-Sum  Test  showed  that  PU>RRFP  was  significamtly  related 


to  both  SCHEDPER  and  SCHEimOD  (a-0.25) .  From  these  results,  PLDRRFP  was 
considered  to  be  a  significant  variable  for  inclusion  in  the  multi - 
variable  analyses. 

Degree  of  Technical  Definition  (TBCHDBFN) .  The  Degree  of 
Technical  Definition  (TECHDEFN)  variable  was  included  in  the  analysis  to 
captxire  the  type  of  specification  that  was  used  2md  whether  or  not  the 
specification  was  complete  at  the  time  of  solicitation.  Of  the  2S 
contracts  for  which  schedule -performance  information  was  obtained,  the 
frequency  distribution  of  this  variable  revealed  that  none  of  the 
contracts  in  the  sample  utilized  a  specification  that  was  less  them  a 
draft  A  specification.  As  a  result  of  this,  TECHDEFN  was  rescaled,  as 
follows  (the  numbers  in  brackets  represent  the  frequency  of  each 
category  in  the  sample) : 

a.  'Partially  Developed  A  Spec'  *  1  (5); 

b.  'Fully  Developed  A  Spec'  «  2  (6) ; 

c.  'Partially  Developed  B  Spec'  »  3  (6);  euid 

d.  'Fully  Developed  B  Spec'  >4  (8). 

The  results  from  the  Kruskal -Wallis  One-Way  ANOVA  Test  showed  that 
TECHDEFN  was  not  significantly  related  to  either  SCHEDPER  or  to  SCHBDMOD 
(a>0.25) .  From  these  results,  TECHDEFN  was  not  expected  to  be  a 
significant  variable  in  the  multi- variable  amalyses;  however,  it  was 
retained  in  the  data-set  to  enable  potential  interactions  to  be 
assessed. 

Develop  WBS  Further  (SOWDWBS) .  The  Develop  WBS  Further  (SOWDWBS) 
variable  was  included  in  the  analysis  to  capture  whether  or  not  the  SOW 
specified  that  the  contractor  was  to  further  develop  the  preliminary 
WBS.  Of  the  25  contracts  for  which  schedule-performance  information  was 


obtained,  the  frequency  distribution  of  this  variable  revealed  that  five 
of  the  contracts  from  the  san^le  did  not  require  that  the  preliminary 
WBS  be  developed  further,  while  20  did. 

The  results  from  the  Mann-Whitney  (Wilcoxon)  Rank-Sum  Test  for 
SONDWBS  showed  that  this  variable  %«as  not  significantly  related  to 
SCSHEDPER  but  was  related  to  SCHEI^D  (cr>0.25).  From  these  results, 
SOWDWBS  was  considered  to  be  a  significant  enough  variable  for  inclusion 
in  the  multi -variable  analyses. 

When  examining  all  of  the  29  contracts  that  were  measured,  some 
interesting  insights  into  the  use  of  WBSs  in  the  contractiial  process 
were  obtained.  Of  tho  five  contracts  for  which  it  was  not  required  to 
further  develop  the  preliminary  WBS,  three  contracts  had  not  developed  a 
preliminary  WBS  in  the  first  place,  while  the  other  two  contracts 
reflected  that  the  SOW  had  not  required  the  preliminary  WBS  to  be 
developed  further.  Interestingly,  of  the  remaining  24  contracts,  three 
contracts  rec[uired  the  contractor  to  develop  a  WBS  for  contract 
mcuiagement  and  reporting  purposes  even  though  a  preliminary  WBS  had  not 
been  developed  in  the  first  place. 

C/SSR  Required  (SOWCSSR) .  The  C/SSR  Required  (SOWCSSR)  variable 
was  included  in  the  ^ulalysis  to  capture  whether  or  not  C/SSR  reporting 
was  specified  in  the  SOW,  and  whether  or  not  this  reporting  was 
integrated  with  schedule-network  information.  Interestingly,  none  of 
the  contracts  in  the  sanqple  required  that  C/SSR  information  be 
integrated  with  schedule-network  information,  and  this  category, 
therefore,  was  eliminated.  Of  the  25  contracts  for  which  schedule - 
perfoannance  information  was  obtained,  the  frequency  distribution  of  this 
variaJjle  revealed  that  10  of  the  contracts  required  cost  auid  schedule 


reporting  in  accordance  with  the  C/SSR  (or  C/SCSC)  requirements,  while 
15  did  not.  The  results  from  the  Mann-Hhitney  (Hilcoxon)  Rank-Sum  Test 
showed  that  SOWCSSR  was  not  significantly  related  to  either  SCHEDPER  or 
SCHEDMOO  (a-0.2S) .  From  these  restilts,  SOWCSSR  was  not  expected  to  be  a 
significant  variable  in  the  multi -variable  analyses;  however,  it  was 
retained  in  the  data-set  to  enable  potential  interactions  to  be 
assessed. 

Management  Paragraphs  (SOWSDISP) .  (SOWRCWP) ,  and 
(SOWRCBP^ .  When  the  OCX  was  created,  the  schedule -management  paragraphs 
in  the  SOW  were  to  be  assessed  using  six  variables.  The  intention  was 
to  obtain  data  that  reflected  increasing  quauitity  and  depth  of  schedule- 
mcUiagement  information,  from  Gantt  charts,  through  different  aspects  of 
network  information,  to  the  examination  of  resource  constraints.  When 
the  contracts  were  measured,  however,  the  expectations  concerning 
schedule-nuuiagement  paragraphs  in  the  SOW  were  not  realized.  Instead, 
the  following  characteristics  were  revealed: 

a.  All  contracts  required,  as  a  minimum,  some  form  of  Gerntt 
chart  to  obtain  schedule-management  information.  Even 
contracts  which  specified  some  form  of  network  also  required 
that  the  schedule -management  information  be  provided  in 
Gantt-chart  format.  For  this  reason,  the  first  two 
variedsles  were  combined  into  a  single  binary- level  variable 
('0'  >  Geuitt  chart,  '1'  >  network  diagram).  This  single 
variable  was  named,  SOW  Schedule  Display  (SOWSDISP) . 

b.  Only  one  of  the  contracts  in  the  sanple  required  that  some 
form  of  probabilistic  network  (e.g.,  PERT)  be  used;  hence, 
this  variable  was  dropped  from  the  analysis. 


c. 


None  of  the  contracts  in  the  san^le  required  that  near- 


critical  paths  be  identified;  hence,  this  variable  was  also 
dropped  from  the  analysis. 

d.  Only  a  few  of  the  contracts  in  the  sample  required  that 

resource  constraints  (either  within  or  between  programs)  be 
addressed  as  an  explicit  part  of  the  schedule -mamagement- 
Information  requirements.  Generally,  this  information  was 
required  as  part  of  one  or  more  DZDs  (e.g..  System 
Engineering  Management  Plan  (SEMP) ,  Training  and  Training 
Equipment  Plan,  Manufacturing  Plan,  Software  Development 
Plam,  System  Test  Plan) .  For  the  purposes  of  measurement, 
if  resource  constraints  were  addressed  either  explicitly  or 
in  one  or  more  of  the  relevant  DIDs,  the  contracts  were 
scored  with  a  '1'.  (Note  that  -tailored  or  modified  DIDs 
were  examined  to  ascertain  whether  or  not  the  relevant 
paragraphs  in  the  DIDs  had  been  modified  or  deleted.) 

As  an  outcome  of  the  preceding  discussion,  three  variables  were  selected 
to  measure  how  schedule-management  information  was  addressed  in  the  SOW: 
SOW  Schedule  Display  (SOWSDISP) ,  SOW  Resource  Constraints  Within  a 
Program  (SOWRCWP) ,  and  SOW  Resource  Constraints  Between  Programs 
(SOWRCBP) . 

-  SOWSDISP .  The  frequency  distribution  of  the  SOW  Schedule 
Display  (SOWSDISP)  variable  revealed  that  18  contracts,  of  the  25  in  the 
sanqple,  required  that  the  schedule-mamagement  information  be  presented 
in  a  networlc  format,  while  the  other  seven  required  a  Gantt  chart 
format.  The  results  from  the  M5uin-Whitney  (Wilcoxon)  Rank- Sum  Test 
showed  that  SOWSDISP  was  significantly  related  to  SCHEDPER  but  not  to 


SCHEDMOD  (a«0.2S) .  From  these  results,  SOWSDISP  was  considered  to  be  a 
significant  enough  variable  for  inclusion  in  the  multi-variable 
analyses . 

SOWRCWP.  The  frequency  distribution  of  the  SON  Resource 
Constraints  Nithin  a  Program  (SONRCNP)  variable  revealed  that  19 
contracts,  of  the  25  in  the  senile,  required  that  resource  constraints 
within  a  program  be  identified,  while  six  did  not.  The  results  from  the 
Mann-Nhitney  (Wilcoxon)  Rank- Sum  Test  showed  that  SONRCNP  was  not 
significantly  related  to  either  SCREDPER  or  SCHEDMOD  (a>0.25) .  From 
these  restilts,  SONRCNP  was  not  expected  to  be  a  significant  variable  in 
the  multi-variable  analyses;  homver,  it  was  retained  in  the  data-set  to 
enable  assessment  of  potential  interactions. 

SONRCBP .  The  frequency  distribution  of  SON  Resource 
Constraints  Between  Programs  (SONRCBP)  variable  revealed  that  16 
contracts,  of  the  25  in  the  saiiq)le,  required  that  resource  constraints 
between  prograuns  be  identified,  while  nine  did  not.  The  results  from 
the  Mann-Nhitney  (Nilcoxon)  Rank-Sum  Test  showed  that  SONRCBP  was  not 
significauitly  related  to  either  SCHEDPER  or  SCHEI^D  (cr>0.25)  .  Prom 
these  results,  SONRCBP  was  not  expected  to  be  a  significauit  variable  in 
the  multi- variable  analyses;  however,  it  was  retained  in  the  data-set  to 
enable  assessment  of  potential  interactions. 


Nhen  the  DCI  was  created,  the  intention  was  to  measure,  on  a  five -point 


scale,  whether  schedule-management  information  was  required  proactively, 


on  a  periodic  basis,  or  reactively.  Interestingly,  only  one  contract  in 
the  sample  required  that  schedule -management  information  be  provided 


proactively  (i.e.,  the  SON  required  that  euiy  problems  that  were  likely 
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to  cauae  schedule  delays  were  to  be  reported) .  FUrthemiore,  the 
frequency  distribution  of  the  Frequency  of  Reporting  Schedule-Management 
Information  (SOHFRSI)  variaJDle  revealed  that  21  contracts,  of  the  25  in 
the  sample,  required  reporting  on  a  monthly  basis.  The  other  three 
required  reporting  on  a  quarterly  or  less  basis.  From  these  results,  a 
decision  was  made  to  convert  SOWFRSI  into  a  binary- level  variable,  as 
follows : 

a.  reporting  less  often  than  monthly  -  'O',  and 

b.  reporting  monthly  or  more  proactively  «  '1' . 

The  results  from  the  Mann-Whitney  (Wilcoxon)  Ranlc-Svim  Test  showed  that 
SOWFRSZ  was  not  significantly  related  to  either  SCHBDPBR  or  SCHEimOD 
(a«0.25) .  From  these  results,  SOHFRSI  was  not  expected  to  be  a 
significant  variable  in  the  multi- variable  analyses;  however,  it  was 
retained  in  the  data-set  to  enable  assessment  of  potential  interactions. 

Number  of  Pro1 ect -management  DIDs  (MOPMDIDS) .  The  Number  of 
Project -numagement  DIDs  (NOPMDIDS)  variable  was  included  in  the  analysis 
to  capture  the  amount  of  project -management  information  that  was 
required  to  be  delivered  by  the  contractor  in  accordance  with  the  CDRL. 
As  this  varl2d>le  is  a  ratio-level  variable,  the  first  step  was  to  assess 
the  relationships  between  this  variable  and  SCHEDPER  /  SCHEIX10D  through 
the  use  of  scatter  plots  (refer  ^pendix  F) .  Following  this,  SLRs  were 
conducted  to  obtain  the  degree  of  significance  of  the  'visual' 
relationships,  and  the  results  obtained  are  presented  in  Table  4-3.  The 
results  from  these  analyses  showed  that  there  was  no  definite 
relationship  between  NOPMDIDS  and  either  SCHEDPER  or  SCHEDMOD  (a«0.25) . 
Furthermore,  a  number  of  different  scaling  techniques  did  not  improve 
upon  this  result.  NOPMDIDS,  therefore,  was  not  ejq>ected  to  be  a 


h 


significant  variable  in  the  multi -variable  analyses;  however,  it  was 
retained  in  the  data-set  to  enable  assessment  of  potential  interactions. 

Number  of  Evaluation  Criteria  (MOBVCRIT) .  The  Number  of 
Evaluation  Criteria  (NOBVCRIT)  variable  was  included  in  the  axialysis  to 
capture  the  relative  inqportance  of  schedule  performance,  as  elucidated 
to  the  contractor  in  the  RFP  (i.e.,  the  number  of  explicit  references  to 
schedule  in  Section  M  of  the  RFP) .  As  this  variable  is  a  ratio- level 
variable,  the  first  step  tras  to  assess  the  relationships  betvreen  this 
variable  and  SCHEDPER  /  SCHEDMOD  through  the  xise  of  scatter  plots  (refer 
i^pendix  F) .  Following  this,  SLRs  were  conducted  to  obtain  the  degree 
of  significance  of  the  'visual'  relationships,  and  the  results  obtained 
are  presented  in  Table  4-3.  The  resxilts  from  these  analyses  showed  that 
there  was  no  definite  relationship  between  NOEVCRIT  and  either  SCHEDPER 
or  SCHEDMOD  (or>0.2S).  Furthermore,  a  number  of  different  scaling 
techniques  did  not  improve  upon  this  result.  NOEVCRIT,  therefore,  was 
not  expected  to  be  a  significant  variable  in  the  multi -varied>le 
2uialyses;  however,  it  was  retained  in  the  data-set  to  enable  assessment 
of  potential  interactions. 


Schedule-Risk  Assessment  (EVSDISP) .  ( 


?)  .  and  (EVRCBP)  . 


When 


the  DCI  was  created,  the  schedule-risk-assessment  paragraphs  in  the 
Instructions  to  Offerors  (ITO)  were  to  be  assessed  using 'ten  variables. 
The  intention  was  to  obtain  data  that  reflected  increasing  quantity  euid 
depth  of  information  --  from  Gantt  charts,  through  different  aspects  of 
network  information,  to  the  examination  of  resource  constraints  and 
responsibility  allocation  --to  obtain  a  measure  of  the  level  of 
schedule -risk  assessment  that  was  able  to  be  performed  as  part  of  the 
source-selection  evaluation.  When  the  contracts  were  measured,  however. 
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th«««  •Jactations  wero  not  realized.  Instead,  the  following 
characteristics  were  revealed: 

a.  All  contracts  in  the  sanqple,  except  two,  required  that  a 
descriptive  assessnent  of  schedule  risks  be  conducted  by  the 
contractor.  For  this  reason,  this  variable  tias  drqpped  from 
the  analysis. 

b.  All  contracts  required,  as  a  minimum,  some  form  of  Gantt 

chart  for  the  presentation  of  schedule  information.  Even 

contracts  which  specified  some  form  of  net%fork  also  required 

that  the  schedule  information  be  provided  in  Gantt -chart 

format.  For  this  reason,  the  second  two  variables  were 

combined  into  a  single  binary- level  variable  ('0'  >  Gantt 

» 

chart,  '1'  m  network  diagram).  This  single  variable  was 
named  Bvalxiation  Schedule  Display  (EVSDISP) .  (Note  that, 
interestingly,  some  contracts  that  required  Gantt  charts  in 
the  offeror's  proposal,  separately  specified  network 
diagrams  in  the  SOW  (and  vice-versa) . ) 

c.  None  of  the  contracts  in  the  sample  required  that  the 
schedule  information  be  derived  from  some  form  of 
probabilistic  network  approach  (e.g.,  PBRT) .  Furthermore, 
none  of  the  contracts  required  thst  near-critical  paths  be 
identified.  For  these  reasons,  both  these  variables  were 
dropped  from  the  analysis. 

d.  Nbne  of  the  contracts  in  the  sample  required  that  the 
offeror  present  a  number  of  different  proposed  schedules  at 
variotis  confidence  levels.  Furthermore,  none  of  the 
contracts  in  the  sao^le  required  that  the  offeror  undertake 


•  program  langth  simulation  study  to  identify  critical  and 
near-critical  paths.  For  these  reasons,  these  two  variables 
were  dropped  from  the  analysis. 

e.  All  of  the  contracts  in  the  sample,  except  two,  required 
that  the  offeror  provide  information  concerning  the 
allocation  of  responsibilities  for  the  proposal.  For  this 
reason,  this  variable  was  dropped  from  the  analysis. 

As  an  outcoow  of  the  preceding  discussion,  three  variables  were  selected 
to  measure  how  schedule- risk-assessment  information  was  addressed  in  the 
XTO:  Bvaluatlon  Schedule  Display  (SVSDZSP) ,  Evaluation  Resoxirce 
Constraints  Mithin  a  Program  (BVRCNP) ,  and  Evaluation  Resource 
Constraints  Batmen  Programs  (EVRCBP)  . 

RVSDISP .  The  frequency  distribution  of  the  Evaluation 
Schedule  Display  (EVSDISP)  variable  revealed  that  14  contracts  in  the 
sample  required  that  schedule-risk-assessment  information  be  presented 
in  network  format  (as  opposed  to  18  for  SOWSDZSP) ,  while  11  did  not . 

The  results  from  the  Mann-Nhitney  (Wilcoxon)  Rank-Sum  Test  showed  that 
EVSDXSP  was  significantly  related  to  both  SCHEDPER  and  SCHEDMOD 
(a>0.25) .  From  these  results,  EVSDXSP  was  considered  to  be  a 
significant  variable  for  incl\ision  in  the  multi -variable  analyses. 

BVRCWP.  The  frequency  distribution  of  the  Evaluation 
Resource  Constraints  Within  a  Program  (EVRCHP)  variable  revealed  that  20 
contracts  in  the  sample  required  that  resource  constraints  within  a 
program  be  identified  (as  opposed  to  19  for  SOWRCHP) ,  while  five  did 
not.  The  resxilts  from  the  Hann-Nhltney  (Wilcoxon)  Rank-Sum  Test  showed 
that  EVRCWP  was  not  significantly  related  to  either  SCHEDPER  or  SCHEDMOD 
(aa0.2S) .  From  these  results,  EVRCWP  was  not  expected  to  be  a 


•ignif leant  variable  in  the  multi -variable  analyses;  hoiraver,  it  was 
retained  in  the  data-set  to  enable  assessment  of  potential  interactions. 

KVRCBP.  The  frequency  distribution  of  the  Evaluation 
Resource  Constraints  Bettfeen  Prograoui  (BVRCBP)  variable  revealed  that  16 
contracts  in  the  sample  required  that  resource  constraints  between 
programs  be  identified  (the  same  number  as  SONRCBP,  but  not  the  same 
contracts),  tdiile  nine  did  not.  The  results  from  the  Mann-Whitney 
(Wilcoxon)  Rank-StOB  Test  shotMd  that  EVRCBP  was  not  significantly 
related  to  either  SCHBDPBR  or  SCHBDMOD  (a>0.25) .  From  these  results, 
BVRCBP  was  not  expected  to  be  a  significant  variable  in  the  multi - 
variable  analyses;  however,  it  tias  retained  in  the  data-set  to  enable 
assessment  of  potential  interactions. 

SuiBHiarv  of  the  Single-variable  Analysis  Results 

This  section  of  Chapter  IV  has  introduced  all  of  the  variables 
that  «rere  measured  during  the  data-collection  process.  The  dependent 
variable,  schedule  perfomumce  (SCHEDPER) ,  was  addressed  first.  From 
the  raw  data,  two  outliers  were  discovered  and  these  were  removed  to 
form  a  second  dependent  variable  (SCHBZB10D) .  Following  this,  each  of 
the  independent  variables  was  addressed,  and  eliminated  if  insufficient 
variability  existed.  In  addition,  appropriate  scaling  was  performed, 
and  single-variable  analyses  were  conducted  to  ascertain  whether  any 
siiiq>le  relationships  existed  with  the  dependent  variad>les,  SCHEDPER  and 
SCHBDMOD. 

The  single-variable  analyses  demonstrated  that  certain  variables 
(e.g.,  MOBCPS)  exhibited  a  definite  relationship  with  one  or  both  of  the 
dependent  variables,  and  that  it  made  sense  to  proceed  to  the  multi- 


variable  axialysas.  Itote  that  the  significance  level  used  for  the 
single-variable  analyses  was  set  at  a>0.2S  to  ens\u:e  that  any  potential 
relationships  would  be  identified.  A  variable  that  was  considered  to  be 
significant  at  this  level  «rould  not  necessarily  be  significant  in  the 
T  multi-variable  analyses,  and  vice-versa;  however,  the  single-variable 

analyses  have  provided  considerable  insight  into  the  nature  of  schedule 
performance  «nd  schedule  management.  The  multi-variable  analyses  are 
the  subject  of  the  next  section. 

Multi -variable  Analyses 

This  section  of  Chapter  IV  will  present  the  multi -variable 
analyses  that  were  conducted  to  address  the  research  questions. 
Specifically,  this  section  will  present: 

a.  a  brief  discussion  of  the  pre-analysis  manipulation  of  the 
variadsles ; 

b .  the  results  of  the  stepwise  regressions  ( i . e . ,  with  both 
SCHEDPER  and  SCHEIM40D)  using  the  full  variable  set; 

c.  the  results  of  the  stepwise  regressions  with  interaction 
terms  included;  and 

d.  the  results  from  the  best  subsets  regressions. 

Pre-analvsia  Manipulation  of  Variables 

^  Prior  to  conducting  the  stepwise  analyses,  the  following  ordinal - 

level  variables  were  recategorized  into  sets  of  dvimmy  variables: 

PLSRISK,  PLTRISK,  COfPLEX,  TECHDEFN,  and  PLHBSL3M.  This 
recategorization  was  necessary  to  ensure  that  the  regression  did  not 
treat  the  ordinal -level  variables  as  interval -level  variables,  as 
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explained  in  Chapter  III.  The  diumy  variables  for  each  ordinal  -  level 
variable  were  then  entered  into,  or  removed  from,  the  stepwise 
regression  model  in  sets  (BMDP  Statistical  Software,  Inc., 

1992:408,  416). 

Full  Variable  Set  Stepwise  Regressions  without  Interactions 

The  BMDP  2R  program  was  used  to  conduct  two  stepwise  regression 
axialyses,  one  for  SCHEDPER  and  one  for  SCHEDMOD.  For  these  regression 
analyses,  a  p- value -to -enter  of  0.1  and  a  p- value -to -remove  of  O.ll  were 
used.  The  edited  data  outputs  from  these  regression  analyses  are 
contained  at  Appendix  H  and  Appendix  I,  respectively.  Each  of  these 
regression  analyses  will  be  discussed  separately. 

SCHEDPER  without  Interactions.  Six  variables  were  entered  into 
the  stepwise  regression  model  for  SCHEDPER,  as  follows:  PLTRISK  (as  a 
set  of  two  dummy  variables) ,  NOBCPS,  PbCONC,  and  PLSRISK  (as  a  set  of 
two  dummy  variables) .  The  value  of  the  F  statistic  and  the  associated 
p-value,  for  the  overall  F  test,  for  this  model  were  6.32  and  0.0010, 
respectively.  The  adjusted  R*  for  this  model  was  0.5709,  which 
indicated  that  approximately  half  of  the  varisd>ility  had  been  explained 
by  the  model.  Plots  of  the  standardized  residuals  and  the  Willc-Shapiro 
Rankit  Plot  are  given  in  Figure  4-4.  The  plot  of  the  standardized 
residuals  did  not  indicate  that  there  were  any  systematic  deviations 
around  the  fitted  regression  line.  The  plot  did  indicate,  however,  that 
the  assumption  of  constancy  of  error  variance  may  have  been  violated. 

For  this  model,  the  variance  appeared  to  increase  as  schedule 
performance  increased.  The  Wilk-Shapiro  statistic  of  0.9051  indicated 
that  the  assumption  of  normality  for  the  distribution  of  the  residuals 


Figure  4-4.  Studardized  Residuals  and  Normality  Assessment 
for  SCHEDPER  (without  Interactions) 
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could  not  reasonably  be  made  (aoO.OS)  (Conover,  1980:468).  Remedial 
measurea  were  not  considered  at  this  stage,  as  this  model  was  an 
intermediate  step  in  the  model -building  process. 

This  initial  analysis  suggested  that  the  fitting  of  a  model  for 
SCHSDPBR  would  be  problematic;  however,  this  initial  model -building  step 
Identified  that  a  number  of  variables  were  significant  (a-0.1),  and  that 
it  made  sense  to  proceed  with  further  model -building.  Before  continuing 
with  the  identification  of  interaction  terms,  ho%rever,  a  multi- variable 
analysis  for  SCHEDMOD  was  conducted  and  the  results  are  presented  in  the 
next  section. 

SCHEDMOD  without  Interactions.  Six  variables  were  entered  into 
the  stepwise  regression  model  for  SCHEDMOD,  as  follows:  NOBCPS, 
PLPRESCH,  TECHDEFN  (as  a  set  of  three  dunrniy  variables),  and  NOD IDS. 
Interestingly,  these  vari«d>les  are  different  from  those  brought  into  the 
model  for  SCHEDPER.  The  value  of  the  F  statistic  and  the  associated 
p-value,  for  the  overall  F  test,  for  this  model  were  42.38  and  0.0000, 
respectively.  The  adjusted  R^  for  this  model  was  0.9186,  which 
indicated  that  the  majority  of  the  variability  had  Iseen  explained  by  the 
model.  Plots  of  the  stauidardized  residuals  and  the  Nilk-Shapiro  Rankit 
Plot  are  given  in  Figvire  4-5.  The  plot  of  the  standardized  residuals 
did  not  indicate  that  there  were  any  systematic  deviations  around  the 
fitted  regression  line.  Contrary  to  the  same  plot  as  for  SCHEDPER,  th^s 
plot  indicated  that  the  assun^tion  of  constancy  of  error  variance  may  be 
upheld.  The  Hilk-Shapiro  statistic  of  0.9551  indicated  that  the 
assvm^tion  of  normality  for  the  distribution  of  the  residtials  could  now 
reasonably  be  made  (a«0.05)  (Conover,  1980:468) .  Remedial  measures  trare 


Figxire  4-5.  Standardized  Residuals  amd  Normality  Assessment 
for  SCHEDMOD  (without  Interactions) 
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not  considered  at  this  stage,  as  this  model  was  an  intermediate  step  in 
the  model -building  process. 

This  initial  analysis  suggested  that  a  model  for  SCHEDMOD  would  be  « 

easier  to  develop  than  for  SCHBDPER,  due  to  the  inproved  fit  of  the 
model.  The  model -building  process  will  continue  at  this  stage  with  the 
identification  of  interaction  terms « 


Full  Variable  Set  Stepwise  Regressions  with  Interactions 

Identification  of  Interaction  Terms.  As  explained  in  Chapter  III, 
potential  two-way  auid  three-way  interaction  terms  were  identified 
through  logical  considerations.  The  final  list  of  interaction  terms 
which  were  incorporated  into  the  model -building  process  comprised  22 
interaction  terms,  as  follows: 


a. 

MPTRISKl 

m 

PLTRISK*NOECPS , 

b. 

MPTRISK2 

a 

PLTRISK*PLWBSDEV, 

c. 

MPTRISK3 

m 

PLTRISK*SOWDWBS, 

d. 

MPTRISK4 

m 

PLTRISK*PLSR1SK, 

e. 

MNOECPSl 

a 

NOECPS*PLCONC, 

f . 

MNOECPS2 

a 

NOECPS  *  PLDRRFP , 

g- 

MN0ECPS3 

a 

NOECPS*EVSDISP, 

h. 

MN0ECPS4 

a 

NOECPS  *TECHDEFN , 

i . 

MN0ECPS5 

a 

NOECPS*UCOSTCD , 

j- 

MN0ECPS6 

a 

NOECPS*COMPLEX, 

k. 

MPSRISKl 

a 

PLSRISK*PLPRESCH , 

1. 

MPSRISK3 

a 

PLSRISK*CC»1PLEX, 

m. 

MPRESCHl 

a 

PLPRESCH*  PLCONC , 

n. 

MPRESCH2 

a 

PLPRESCH*  PLDRRFP , 

o. 

MPRESCH3 

a 

PLPRESCH*  SOWRCWP , 

P- 

MPRESCH4 

a 

PLPRESCH*EVRCNP , 

q- 

MPLAGGR 

a 

PLAGGR*SOWSDISP, 

r. 

MSOWRC 

a 

SOWRCBP*SOWRCWP , 

s. 

MPLC0NC3 

= 

PLCONC*PLSRISK, 

t. 

MPRESCH6 

- 

PLPRESCH*PLAGGR*PLCONC , 

u. 

MSOHSINT 

- 

SOHSDISP*SOWRCHP*SOVmCBP , 

V. 

MEVSINT 

EVSDISP*BVRCWP*EVRCBP . 

The  two  previous  stepwise  regressions  ( i . e . ,  one  for  SCHEDPER  and  one 
for  SCHEDMOD)  were  re-run,  with  these  interaction  terms  included  in  the 
BMDP  2R  commeuid  files,  to  ascertain  whether  the  models  would  change  as  a 
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result  of  the  inclusion  of  the  interaction  terms.  The  results  of  these 
runs  are  discussed  next,  for  both  SCHEDPER  and  SCHEDMOD. 

SCHEDPER  with  Interactions.  The  stepwise  regression  for  SCHEDPER, 
the  results  of  which  are  contained  in  i^endix  J,  ran  for  thirteen 
steps:  steps  1  to  9  brought  in  MPRSSCH3,  SONSDISP,  NOECPS,  MSOWSZNT, 
PAGESSOW,  TECHDEFN  (as  a  set  of  three  dummy  variadjles) ,  EVRCNP,  MEVSZHT, 
wd  PLTRZSKl  (PLTRZSK2,  the  Other  dummy  variable  in  the  PLTRZSK  set,  was 
not  included  due  to  collinearity  problems) ;  step  10  removed  PAGESSOW  and 
entered  PLTRZSK2  (although  the  summary  table  amd  edited  data  output  in 
Appendix  J  does  not  show  this) ;  step  ll  removed  SOHSDZSP;  and  finally, 
steps  12  and  13  brought  in  SOWCSSR  and  MPRESCH2.  The  value  of  the 
F  statistic  and  the  associated  p-value,  for  the  overall  F  test,  for  this 
model  were  44.68  and  0.0000,  respectively.  The  final  model  had  eui 
adjusted  R’  of  0.9562,  which  indicated  that  the  majority  of  the 
variability  had  been  explained  by  the  model. 

A  number  of  problems  were  noted  with  this  model,  however,  and 
these  are  explained  as  follows: 

a.  The  final  model  contained  13  variables,  which,  given  the 
san^le  size  of  25,  was  considered  to  be  an  'over- fit.' 

b.  At  step  nine,  only  one  of  the  dummy  variables  (PLTRZSKl)  for 
the  technical  risk  (PLTRZSK)  set  was  entered  into  the  model, 
which  did  not  make  sense. 

To  overcome  these  problems,  a  reduced  set  of  variables  was  fitted  in  the 
model.  As  explained  in  Chapter  ZZZ,  Neter,  Wasserman,  and  Kutner 
recommend  that,  as  a  minimum,  six  to  ten  cases  are  required  per  variable 
in  the  model  (Neter,  Wasserman,  and  Kutner,  1989:435) .  For  SCHEDPER, 


therefore,  only  the  first  four  variables  could  be  fitted  in  the  model. 


Interestingly,  this  limitation  corresponded  to  the  point  in  the  model - 
building  process  «diere  a  p- value- to-enter  of  0.05,  and  a 
p-value- to- remove  of  0.051,  applied,  in  lieu  of  the  0.1  level  that  was 
utilized  in  the  BMDP  program  execution.  Further  detailed  analysis  of 
the  SCHEDPBR  model  with  this  reduced  variable-set  ms  conducted  using 
Statistix  4.0. 

The  Model.  The  four  variables  that  were  defined  in  the 
regression  model  for  SCHEDPBR  were  as  follows:  MPRESCH3  (PLPRESCH* 
SOWRCHP) ,  SOWSDISP,  NOECPS,  and  MSOWSINT  (SOWSDZSP*SOWRCWP*SOWRCBP) . 

The  regression  results  for  this  model  are  contained  in  Appendix  L. 

These  variables  resulted  in  the  following  model: 

SCHEDPER  -  150.08  +  -109 .64*MPRESCH3  +  -120 . 30*SOWSDZSP 

1.28*NOECPS  +  73 . 09*MSOWSINT 

The  value  of  the  F  statistic  and  the  associated  p-value  for  the  overall 
F  test,  for  this  model,  were  8.88  and  0.0003,  respectively.  The 
adjusted  R^  for  this  model  was  0.5678,  which  indicated  that 
approximately  half  of  the  varicd>ility  had  been  explained  by  the  model. 
The  p-values  associated  with  the  t  tests  for  the  parameter  estimates 
were  as  follows: 


a. 

Constant 

(150.08)  : 

P 

0.0001; 

b. 

MPRESCH3 

(-109.64)  : 

P 

m 

0.0005; 

c. 

SONSDZSP 

(-120.30) : 

P 

m 

0.0009; 

d. 

NOECPS 

(1.28)  ; 

P 

- 

0.0154; 

e. 

MSOWSINT 

(73.09)  : 

P 

0.0313. 

These  p-values  showed  that  all  of  the  varied>les  were  significant  at  the 
a>i0 . 05  level .  One  puzzling  aspect  of  this  model  was  the  contradiction 


in  sign  for  the  coefficients  for  the  related  variables,  SOWSDISP  and 
MSOWSIMT.  This  will  be  discussed  after  the  remedial  measures  have  been 
addressed. 

Assessment  of  Model  Aptness.  Plots  of  the  standardized 
residuals  and  the  Wilk-Shapiro  Rankit  Plot  are  given  in  Figure  4-6.  The 
plot  of  the  standardized  residuals  indicated  that  there  was  only  one 
outlier  of  amy  significance  (i.e.,  greater  than  three  sigma):  Case  #24. 
Furthermore,  the  plot  indicated  that  the  assumption  of  constancy  of 
error  variance  may  not  hold  for  this  model:  error  variance  appeared  to 
increase  as  schedule  performance  increased.  The  Wilk-Shapiro  statistic 
of  0.9262,  hovrever,  indicated  that  the  assumption  of  normality  for  the 
distribution  of  the  residiials  could  be  made  (a-O.O.*:'  (Conover, 

1980:468).  The  time  series  plot  of  the  regression  residtials  is  given  in 
Figure  4-7.  This  plot  indicated  that  the  error  terms  were  not 
correlated  over  time.  This  'visual'  result  was  confirmed  by  the  Durbin- 
Watson  statistic  for  autocorrelation  of  2.3027,  which  indicated  that  the 
error  terms  were  independent  (ar>0.05)  (Analytical  Software, 

1992:146-147)  . 

Assessment  of  Influence. .  From  Statistix  4.0,  the  plot  of 
the  trauisformed  Cook's  distance  was  obtained,  and  is  reproduced  in 
Figure  4-7.  As  explained  in  Chapter  III,  an  F  distribution  percentile- 
value  of  20  percent  was  used  to  assess  which  cases  were  exerting  at 
least  moderate  influence  on  the  values  of  the  coefficients  (i.e.,  in  the 
plot  presented  in  Figxire  4-7,  any  case  with  a  transformed  Cook's 
distance  less  than  0.8) .  Using  this  criterion,  one  case  was  identified 
as  influential,  with  a  moderate  Influence  value  of  0.7800:  Case  #24 
(SCHEDPER-334.0%,  MPRESCH3-0,  SOHSDZSP-0,  NOECPS-35,  MSOWSINT-0) . 


Figure  4-6.  Standardized  Residtials  and  Normality  Assessment 
for  SCHEDPER  (with  Interactions) 
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Figure  4- 


Tlme  Series  Plot  and  Transformed  Cook's  Distance  for 
SCHEDPBR  (with  Interactions) 
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Int«r«atli3gly,  Caae  #24  waa  tha  caaa  that  tiaa  idantified  aa  an  outliar 
from  tha  plot  of  tha  atandardlxad  raaiduala. 

Hodal  with  Caaa  #24  Dalatad.  To  aaaaaa  tha 
aignlficanca  of  Caaa  #24,  tha  ragraaalon  modal  waa  raflttad  with  thia 
caaa  dalatad.  Tha  ragraaalon  raatilta  for  thla  ravlaad  modal  ara 
contalnad  in  Appandlx  L.  Tha  valtia  of  tha  P  atatlatic  and  tha 
aaaociatad  p-vmlua  for  tha  ovarall  P  taat,  for  thia  modal,  wara  7.97  and 
0.0006,  raapactlvaly,  aa  comparad  with  8.88  and  0.0003  for  tha  modal 
with  Caaa  #24  included.  Purtharmora,  tha  adjuated  for  the  reviaed 
modal  dacraaaad  from  0.5678  to  0.5479  after  Caaa  #24  waa  removed,  which 
indicated  that  laaa  of  tha  variability  had  bean  explained  by  thia  model. 
Tha  raaaon  that  a  modal  «raa  obtained  that  did  not  fit  aa  %rall  waa  able 
to  be  readily  identified  from  the  plot  of  the  atandardized  reaiduals  and 
from  the  Nilk-Shapiro  Rankit  Plot:  the  reviaed  model  contained  an 
outliar  at  almoat  four  atandard  daviationa  from  tha  regreaaion  line. 

Tha  plot  of  tha  tranaformed  Cook' a  Diatanca  identified  the  outlier  as 
Caaa  #21  (SCHBDPBR-263.0%,  MPRESCH3-0,  SOWSDISP-0,  NOECPS-16, 

MSOHSIRT-O) ,  which  had  a  aignlf leant  influence  value  of  0.3529. 

The  majority  of  tha  regreaaion  coefficienta  changed 
aignificantly  from  tha  modal  with  Caae  #24  included.  The  new  values  for 
the  coefficients  and  the  p-values  for  the  associated  t  tests  were 
obtained,  and  are  given  in  tha  following  list.  (Note,  the  numbers  in 
parentheses  are  the  previous  values  for  the  coefficients.) 


a. 

Constant  ■>  112.66 

(150.08) : 

P  • 

0.0002, 

b. 

MPRBSCH3  «  -85.54 

(-109.64) : 

P  - 

0.0007, 

c. 

SOWSDISP  -  -84.25 

(-120.30) ; 

P  - 

0.0040, 

d. 

MOBCPS  -  1.22 

(1.28)  : 

P  - 

0 . 0043 ,  and 

a.  NSONSINT  -  S6.36  (73.09):  p  -  0.0353. 

As  axplainad  In  Chapter  III,  a  99%  prediction  interval 
for  schedule  performance  ms  obtained  for  Case  #24  from  the  model  for 
SCHBDPBR  with  Case  #24  excluded.  The  lower  bo\md  of  this  prediction 
interval  for  schedule  performance  was  20.2%,  while  the  vipper  bovind  %iras 
290.6%.  This  result  s\ipported  the  hypothesis  that  Case  #24,  with  an 
actual  schedule  performance  of  334.0%,  may  be  from  a  different 
population  to  that  of  the  rest  of  the  sample.  Piirther  discxission  of 
whether  or  not  Case  #24  should  be  excluded  from  the  sample  will  be 
reserved  until  the  remedial  diagnostics  for  the  model  for  SCHBDPER  are 
completed . 

Model  with  Case  #21  and  Case  #24  Deleted.  To  assess 
the  significance  of  Case  #21,  the  regression  model  was  refitted  with 
this  case  deleted  (i.e.,  now  both  Cases  #21  and  #24  have  been  deleted 
from  the  model) .  The  regression  results  for  this  second  revised  model 
are  contained  in  J^ipendix  L.  The  value  of  the  F  statistic  auid  the 
associated  p-value  for  the  overall  F  test,  for  this  model,  were  19.02 
and  0.0000,  respectively,  as  compared  with  8.88  and  0.0003  for  the  model 
with  Case  #21  <uid  Case  #24  included.  Furthermore,  the  adjusted  for 
this  second  revised  model  increased  from  the  previoiis  models  to  0.7661, 
which  showed  that  approximately  three  quarters  of  the  variability  had 
been  explained  by  the  model.  Plots  of  the  standardized  residuals  auid 
the  Willc-Shapiro  Rjuikit  Plot  are  given  in  Figxure  4-8.  The  plot  of  the 
standardized  residuals  did  not  indicate  that  there  were  any  outliers, 
nor  that  there  were  any  systematic  deviations  around  the  fitted 
regression  line.  Furthermore,  the  plot  of  the  standardized  residuals 
indicated  that  the  assumption  of  constancy  of  error  variance  may  hold 


Figure  4-8.  Standardized  Residuals  and  Normality  Assessment, 
(with  Interactions) ,  Cases  #21  and  #24  Excluded 


SCHBDPER 
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for  this  model.  The  Hilk-Shapiro  statistic  of  0.9743  indicated  that  the 
aasuB^tion  of  normality  for  the  distribution  of  the  residuals  could  be 
made  (ar>0.05)  (Conover,  1980:468).  From  the  influence  measure 
(transformed  Cook's  distance)  obtained  from  Statistix  4.0,  none  of  the 
remaining  cases  were  significant  from  an  influence  perspective.  From 
these  diagnostics,  therefore,  this  second  revised  model  appeared  to  be 
valid  and  to  meet  the  assun^tions  of  the  normal-error  regression  model. 

The  regression  coefficients  changed  significantly  once 
again.  The  new  values  for  the  coefficients  and  the  p- values  for  the 
associated  t  tests  were  obtained,  azid  are  given  in  the  following  list. 
(Note,  the  numbers  in  parentheses  are  the  previous  values  from  the  model 
with  Case  #24  deleted,  and  from  the  original  model,  respectively.) 


a. 

Constamt 

- 

54.04 

(112.66, 

150.08) : 

P 

■ 

0.0026, 

b. 

MPRESCH3 

m 

-52.79 

(-85.84, 

-109.64) : 

P 

0.0004, 

c. 

SONSDISP 

m 

-36.90 

(-84.25, 

-120.30) : 

P 

m 

0.0253, 

d. 

NOECPS 

- 

1.42 

(1.22, 

1.28) : 

P 

m 

0.0000,  amd 

e. 

MSOWSINT 

35.68 

(56.36, 

73.09) : 

P 

m 

0.0160. 

As  explained  in  Chapter  III,  a  99%  prediction  interval 
for  schedule  performance  was  obtained  for  Case  #21  from  the  model  for 
SCHEDPER  with  Case  #21  and  Case  #24  excluded.  The  lower  bound  of  this 
prediction  interval  for  schedule  performance  was  1.4%,  while  the  upper 
bound  was  152.2%.  This  result  supported  the  hypothesis  that  Case  #21, 
with  an  actual  schedule  performance  of  263.0%,  may  Ise  from  a  'It.iferent 
population  than  the  rest  of  the  sample.  Furthermore,  the  prediction 
interval  for  schedule  performance  from  this  model  for  Case  #24,  with  am 
actual  schedule  performamce  of  334.0%,  ramged  from  29.2%  to  178.5%. 
Further  discussion  of  whether  or  not  Case  #21  amd/or  Case  #24  should  be 


•xclvtdad  from  the  senile  will  be  reserved  tmtil  the  remedial  diagnostics 
for  the  model  for  SCHEDPBR  are  completed. 

Interestingly,  the  two  cases  that  were  removed  from 
the  SCSEDPBR  model  using  the  regression-diagnostics  (Case  #21  and  Case 
#24)  were  the  same  two  cases  that  were  removed  from  SCHBOPER  earlier  in 
this  chapter  to  obtain  SCHBDMOO.  The  results  obtained  through  the 
regression-modelling  approach  confirmed  that  the  two  cases  were  indeed 
outliers.  The  assessment  of  whether  or  not  these  two  cases  should  be 
excluded  from  the  sample  was  now  able  to  be  made. 

Diseusaion  of  Case  #24.  Case  #24  was  Contract  Number 
F33657-88-C-0091,  Contingency  Airfield  Lighting  System  (CALS) . 
Discussions  with  the  buyer  responsible  for  this  contract  indicated  that 
this  particular  acquisition  had  been  subject  to  significant  disruption 
as  a  result  of  the  Gulf  War.  The  acttial  schedule  performance, 
therefore,  was  deemed  to  be  unrepresentative  of  programs  having  similar 
attributes.  This  did  not  mean,  however,  that  the  case  was  from  a 
different  population;  rather,  the  most  likely  conclusion  was  that  the 
case  represented  a  sitiiation  where  other  inportemt,  but  not  measured, 
independent  variables  would  provide  the  necessary  explanatory  power. 
(Note,  another  explamation  could  be  that,  with  a  larger  sample  size, 
more  variables  would  be  able  to  be  validly  included  in  the  model,  and 
these  additioxial  variables  would  increase  the  explanatory  power . )  On 
this  basis,  the  decision  to  exclude  this  case  from  the  sample  was 
justified. 

Discussion  of  Case  #21.  Case  #21  was  Contract  Number 
F33657-87-C-2092,  Aircrew  Bye/Respiratory  Protection  (AERP)  Systems. 

This  particular  contract  was  the  only  contract  in  the  sample  that  was 


rated  as  high  for  schedule  risk.  The  SPO,  therefore,  knew  when  the 
contract  was  let  that  the  contracted  schedule  was  unrealistic  and, 
perhaps,  unreasonable.  As  this  contract  was  the  only  case  with  a  high 
schedule  risk  assessment,  this  attribute  was  unable  to  be  adecfuately 
modeled.  This  did  not  mean,  however,  that  the  case  was  from  a  different 
popiilation;  rather,  that  sufficient  eiqplanatory  power  was  unable  to  be 
obtained  to  model  this  single  occurrence.  (Note,  another  explanation 
could  be  that,  with  a  larger  sanqple  size  that  contained  more  cases  with 
schedule  risk  rated  above  medium,  more  varlad>les  would  be  able  to  be 
validly  included  in  the  model,  and  these  additional  variables  would 
increase  the  explanatory  power.)  On  this  basis,  the  decision  to  exclude 
this  case  from  the  sample  was  also  jxistified. 

Interpretation  of  the  Coefficients.  The  final  model  for 
SCHEDPSR,  with  Case  #21  and  Case  #24  excluded,  was  as  follows: 

SCHEDPBR  *  54.04  +  -52 . 79*MPRESCH3  -36 . 90*SOWSDISP 

1.42*NOECPS  -t-  35.68*MSOHSINT 

The  interpretation  of  the  coefficients  of  this  model  are  as  discussed  in 
the  following  sub-paragraphs. 

Interpretation  of  b,.  The  y- intercept  for  the 
regression  model  is  equal  to  54.04  percentage  units.  While  this  point 
is  an  extrapolation  beyond  the  data,  an  interpretation  for  this 
coefficient  could  be  that,  if,  for  a  particular  contract,  there  were  no 
contract  modifications,  the  contract  was  not  pre-scheduled  or  the  SOW 
did  not  require  resource  constraints  within  a  program  to  be  evaluated, 
and  the  SOW  did  not  require  schedule-management  information  in  a  network 
format  (which  removes  the  effect  of  both  the  SOWSDISP  euid  MSOWSINT 


variables) ,  then  the  point  estimator  for  schedule  performance  for  that 
contract  tnovild  be  54.04  percentage  units 

Interpretation  of  b..  If  a  particiilar  contract  were 
pre- scheduled  and  the  SON  tasked  the  contractor  to  evalxiate  resource 
constraints  within  a  program,  then  the  resultant  schedule  performance 
«pould  improve  by  52.79  percentage  units  compared  with  a  contract  that 
did  not  incorporate  both  of  these  attributes  (for  the  same  number  of 
contract  modifications) . 

Interpretation  of  b,.  If  a  particular  contract  tasked 
a  contractor,  via  the  SON,  to  generate  schedule -management  information 
in  a  network  format,  then  the  resultant  schedule  performance  would 
inprove  by  36.9  percentage  units  compared  with  a  contract  that  did  not 
incorporate  this  attribute  (for  the  same  nvunloer  of  contract 
modifications) . 

Interpretation  of  tx.  For  a  particular  contract,  as 
the  number  of  contract  modifications  increases,  schedule  performance 
worsens  at  the  rate  of  1.42  percentage  units  per  contract  modification. 

Interpretation  of  b^.  If  a  particular  contract  tasked 
a  contractor,  via  the  SON,  to  generate  schedule-management  information 
in  a  network  format  and  to  evaluate  resource  constraints  within  a 
program  and  between  programs,  then  the  resultant  schedule  performance 
would  worsen  by  35.68  percentage  units  compared  with  a  contract  that  did 
not  incorporate  these  attributes  (for  the  same  nxuidser  of  contract 
modifications) . 

Discussion  of  the  Coefficients.  Nith  the  exception  of 
the  coefficient  for  the  MSONSINT  (SONSDISP*SOWRCWP*SOWRCBP)  variable 
(b4) ,  the  coefficients  for  the  other  variables  in  the  model  were 


consistent  with  intuition.  The  coefficient  for  the  MSOWSINT  varicible  is 
coimter- intuitive,  in  that  the  sign  is  opposite  to  that  of  the 
coefficient  for  the  related  variables,  MPRESCH3  and  SOHSDISP.  This 
counter-intuitive  result  probably  occurred  due  to  an  artifact  of  the 
sample  and,  for  this  reason,  the  significance  of  the  MSOWSINT  variable 
is  in  question. 

Further  analysis  of  the  revised  SCHEDFER  model, 
developed  through  the  model -building  approach  discussed  in  this  section, 
was  not  required  because  the  dependent  variable,  with  Case  #21  and 
Case  #24  excluded,  tiras  equivalent  to  SCHBDMOD.  The  model -building 
process  for  SCHEDPER,  however,  has  resulted  in  a  statistically 

e 

signific2uit  model  and  has  enabled  a  ntimber  of  independent  varied>les  to 
be  identified.  To  build  on  this  knowledge,  a  more  significeuit  model, 
using  different  variables,  was  obtained  u.‘»’ng  the  stepwise  model¬ 
building  approach  with  SCBEmOD  as  the  dependent  variable.  This  model 
is  discussed  in  the  next  section. 

SCHEDMOD  with  Interactions.  The  stepwise  regression  for  SCHEDMOD, 
the  results  of  which  are  contained  in  Appendix  K,  ram  for  five  steps  auid 
included  seven  variables:  steps  1-5  brought  in  NOECPS,  PLPRESCH, 
MNOECPSl  (NOECPS*PLCONC)  ,  TECHDEFN  (as  a  set  of  three  diinmy  variaUsles)  , 
and  NODIDS.  As  explained  earlier  in  this  chapter,  this  stepwise 
approach  resulted  in  a  model  that  was  'over-fitted. '  For  SCHEDMOD, 
therefore,  only  the  first  three  variables  could  be  fitted  in  the  model 
because  TECHDEFN,  comprised  of  three  dummy  variables,  added  too  many 
variables  in  the  fourth  step.  Further  detailed  analysis  of  the  SCHEDMOD 
model  with  this  reduced  variable-set  was  conducted  using  Statistix  4.0, 


and  the  results  are  contained  in  Appendix  L. 


Tha  Model.  The  three  vari«d>les  that  were  defined  in  the 


regression  model  for  SCHEDMOD  were  as  follows:  NOGCPS,  PLPRBSCH  and 
MNOECPSl.  These  variables  resulted  in  the  following  model: 

SCHEDMOD  -  35.02  l.S9*NOECPS  -46 . 72*PLPRESCH  +  1 . 19*MN0ECPS1 

The  value  of  the  F  statistic  and  the  associated  p-value  for  the  overall 
F  test,  for  this  model,  were  51.66  and  0.0000,  respectively.  The 
adjusted  for  this  model  was  0.8736,  which  indicated  that  the  majority 
of  the  variability  had  been  explained  by  the  model.  The  p-values 
associated  with  the  t  test  for  the  parameter  estimates  were  as  follows: 


a. 

Constant 

(35.02)  : 

P  - 

0.0025; 

b. 

NOECPS 

(1.59)  : 

P  - 

0.0000; 

c. 

PLPRESCH 

(-46.72)  : 

P  - 

0.0001;  and 

d. 

MNOECPSl 

(1.19)  : 

p  - 

0.0013. 

These  p-values  showed  that  all  of  the  variables  were  significant  at  the 
a«0.05  level. 

Assessment  of  Model  Aptness.  Plots  of  the  standardized 
residuals  and  the  Wilk-Shapiro  Rankit  Plot  are  given  in  Figure  4-9.  The 
plot  of  the  standardized  residuals  indicated  that  there  were  no  outliers 
of  any  significance  (i.e.,  greater  than  three  sigma);  however,  one 
outlier  was  close  to  being  significant:  Case  #23  (-2.97  sigma).  The 
plot  of  the  standardized  residuals  also  indicated  that  the  assiimption  of 
constancy  of  error  variance  may  only  tentatively  hold  for  this  model . 

The  Wilk-Shapiro  statistic  of  0.9257  indicated  that  aui  assun^tion  of 
normality  for  the  distribution  of  the  residuals  could  be  made  (a>0.05) 
(Conover,  1980:468).  The  time  series  plot  of  the  regression  residuals 
is  given  in  Figure  4-10.  This  plot  indicated  that  the  error  terms  were 


Figture  4-9.  Standardized  Residuals  and  Normality  Assessment 
for  SCHBimOD  (with  Interactions) 
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Figure  4-10. 


Time  Series  Residuals  and  TrcUisformed  Cook's  Distance 
for  SCHEDMOD  (with  Interactions) 
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not  correlated  over  time.  This  'visxial'  result  was  confizmed  by  the 
Durbin-Natson  statistic  for  autocorrelation  of  2.1056,  which  indicated 
that  the  error  terms  were  independent  (cr-0.05)  (Analytical  Software, 
1992:146-147) . 

Assessment  of  Influence.  From  Statistix  4.0,  the  plot  of 
the  transformed  Cook's  distance  was  obtained,  and  is  given  in 
Figure  4-10.  From  this  plot,  one  case  was  identified  as  influential, 
with  a  moderate  influence  value  of  0.5208:  Case  #23  (SCHEDM0D«46 . 8%, 
NOBCPS-19,  PLPRESCH-O,  and  MN0ECPS1»19) .  As  expected,  this  was  the  case 
which  was  assessed  as  being  almost  an  outlier  from  the  plot  of  the 
standardized  residuals. 

Model  with  Case  #23  Deleted.  To  assess  the 
significance  of  Case  #23,  the  regression  model  was  refitted  with  this 
case  deleted.  The  regression  results  for  this  revised  model  are 
contained  in  l^pendix  L.  The  value  of  the  F  statistic  and  the 
associated  p-value  for  the  overall  F  test,  for  this  model,  were  96.75 
euid  0.0000,  respectively.  The  adjusted  for  this  new  model  increased 
from  0.8736  to  0.9319,  which  indicated  that  a  greater  amovint  of  the 
variability  had  been  explained  by  this  model.  The  Wilk-Shapiro 
statistic  also  increased  to  0.9678,  which  indicated  that  aui  assun^tion 
of  normality  for  the  distribution  of  the  residuals  could  reasonably  be 
made  (aa0.05)  (Conover,  1980:468).  A  new  plot  of  the  transformed  Cook's 
distance  further  revealed  that  there  were  no  additional  outliers. 

The  regression  coefficients  changed  moderately  from 
the  model  with  Case  #23  included.  The  new  values  for  the  coefficients 


and  the  p-values  for  the  associated  t  tests  were  obtained,  and  are  given 


in  the  following  list.  (Note,  the  numbers  in  parentheses  are  the 


previous 

values  for  the 

coefficients. ) 

a. 

Constant  ■ 

48.39 

(35.02) : 

P  - 

0.0000; 

b. 

NOECPS 

1.S5 

(1.59) : 

P  - 

0.0000; 

c. 

PLPRESCH  «  - 

60.10 

(-46.72)  : 

P  - 

0 . 0000 ;  and 

d. 

MNOECPSl  « 

1.33 

(1.19) : 

P  - 

0.0000. 

As  explained  in  Chapter  III,  a  99%  prediction  interval 
for  schedtile  performance  was  obtained  for  Case  #23  from  the  model  for 
SCHEDMOO  with  Case  #23  excluded.  The  lower  bound  of  this  prediction 
interval  for  schedule  performance  was  62.2%,  while  the  upper  bound  was 
144.1%.  This  result  supported  the  hypothesis  that  Case  #23,  with  an 
actxial  schedule  performance  of  46.8%,  may  be  from  a  different  population 
to  that  of  the  rest  of  the  sample.  Further  discussion  of  whether  or  not 
Case  #23  should  be  excluded  from  the  sample  will  be  reserved  until  the 
remedial  diagnostics  for  the  model  for  SCHEDMOD  are  completed . 

Discussion  of  Case  #23.  Case  #23  was  contract  number 
F33657-88-C-0029,  C-17  Aircrew  Training  System  (ATS) .  While  the 
exclusion  of  Case  #23  resulted  in  an  improved  model,  there  was  no 
justifiable  reason  to  remove  the  case;  it  simply  represented  a 
configuration  of  covariates  that  was  entirely  plausible  but  with  eui 
unusual  outcome  (i.e.,  schedule  performance  better  than  the  99% 
predicted  value) .  For  this  reason.  Case  #23  was  not  excluded  from  the 
final  model.  Potentially,  with  increased  sample  size,  this  case  may  no 
longer  be  an  outlier;  this  is  further  justification  for  retaining  the 
case  in  the  sample. 

Interpretation  of  the  Coefficients.  The  final  model  for 


SCHEDMOO  was  as  follows: 


SCHEDMOD  -  35.02  4-  l.S9*MOBCPS  +  -46 . 72*PLPRESCH  *  1 . 19*MtlOBCPSl 


The  interpretation  of  the  coefficients  of  this  model  are  as  discussed  in 
the  following  sub-paragraphs. 

Interpretation  of  b..  The  y- intercept  for  the 
regression  model  is  equal  to  35.02  percentage  units.  While  this  point 
is  an  extrapolation  beyond  the  data,  an  interpretation  for  this 
coefficient  could  be  that,  if,  for  a  particular  contract,  there  were  no 
contract  modifications  and  the  contract  was  not  pre- scheduled,  then  the 
point  estimator  for  schedule  performance  for  that  contract  would  be 
35.02  percentage  units. 

Interpretation  of  b. .  For  a  particular  contract,  as 
the  number  of  contract  modifications  increases,  schedule  performance 
worsens  at  the  rate  of  1.59  percentage  units  per  contract  modification. 

Interpretation  of  b,.  If  a  particular  contract  wsre 
pre -scheduled,  then  the  resultwt  schedule  performance  would  iR^>rove  by 
46.72  percentage  units  compared  with  a  contract  that  did  not  incorporate 
this  attribute  (for  the  same  number  of  contract  modifications) . 

Interpretation  of  b,.  If  a  particular  contract  were 
to  involve  concxirrency,  then,  as  the  number  of  contract  modifications 
increases,  schedule  performance  worsens  at  an  increased  rate  of  2.78 
(i.e.,  1.59  -f  1.19}  percentage  units  per  contract  modification. 

Discussion  of  the  Coefficients.  The  coefficients  for 
all  the  variables  in  the  model  were  consistent  with  intuition.  With 
respect  to  b,,  the  effect  of  this  interaction  term  was  to  increase  the 
slope  of  the  regression  fxmction  when  concnirrency  was  present  in  the 


program . 


A  plot  of  the 


Pint-  nf  fhm  vinmi  firmtnMQD  ReoreBBion  Model 
final  regression  model  developed  from  SCHBI3M0D  is  given  in  Figure  4-11. 

This  plot  was  generated  using  Mathcad  4.0  and  graphically  shows  the  ^ 

limitations  of  the  regression  model.  The  single  most  important 
limitation  demonstrated  by  this  plot  ms  that  the  regression  fxinction  ^ 

had  a  limited  number  of  data  points  beyond  approximately  50  contract 
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Figure  4-11.  Plot  of  the  Final  Regression  Model  for  SCHEDMOD 
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Dodlflcationa.  This  limitation  suggasted  that  inferences  beyond  this 
point  were  of  qpiestionable  value.  The  plot  also  demonstrated  the  effect 
of  both  the  binary-level  variable,  PLPRBSCH,  and  the  interaction 
variable ,  MNOBCPSl  ( i . e . .  PLC(XIC*NOBCPS) . 

Summary  of  the  stepwise  Raoreasion  Results 

This  section  of  Chapter  IV  has  presented  the  results  of  the 
stepwise  multi-variable  analyses.  Initially,  stepwise  regression 
techniques  were  utilised,  with  models  containing  no  interaction  terms, 
to  ascertain  whether  or  not  it  made  sense  to  proceed  with  obtaining  a 
multi -variable  model.  Secondly,  potential  interaction  terms  were 
identified  through  logical  considerations.  Following  this,  a  regression 
model  for  SCHEDPER,  was  obtained.  Analysis  of  this  model  indicated  that 
there  were  two  significant  outliers,  which,  when  removed,  considerably 
improved  the  fit  of  the  model.  These  two  outliers  were  the  two  cases 
that  were  identified  when  schedule  performance  was  initially  reviewed 
earlier  in  this  chapter.  Removal  of  these  two  outliers  resulted  in  a 
model  which  effectively  employed  SCHEZ3M0D  as  the  dependent  variable  ,- 
hence,  further  analysis  of  the  model  developed  from  SCREDPER  was  not 
required. 

The  model  that  was  obtained  for  SCHEDMOD  contained  three 
variables.  Analysis  of  this  model  revealed  a  well -fitting  model  which 
met  the  assumptions  of  the  normal-error  regression  model.  Having 
completed  the  stepwise  model -building  process,  the  next  step  is  to 
supplement  the  information  obtained  from  this  process  by  examining  the 
results  obtained  from  the  best  subsets  regression  models. 


B<«t  8ub«et«  Reareaaion 


Introduction.  As  discussed  in  Chapter  III,  best  subsets 
regression  ms  used  to  supplement  the  informstion  gained  from  the 
stepwise  regression  analyses.  This  section  will  discuss  the  best 
subsets  regression  results  by  addressing: 

a.  the  pre-analysis  manipulation  of  the  variables,  and 

b.  the  results  from  the  beat  subsets  regressions  for  SCHSDPER 
and  for  SCHBZMOO. 

Pre-Analveia  Manipulation  of  Variables.  Prior  to  conducting  the 
best  subsets  regressions,  the  following  ordinal -level  variables  mre 
recategorized  into  binary-level  variables:  PLSRISK,  PLTRISK,  TBCHDBFN, 
and  PLHBSL3M.  These  foxir  variables  were  renamed,  respectively:  PLSRM, 
PLTRM,  TDBFM,  and  PLHL3M.  This  recategorization  was  necessary  because 
the  softmre  used  to  perform  the  best  subsets  regressions  could  not 
handle  ordinal -level  variables  recoded  into  dummy  variable  sets. 

After  the  ordinal -level  variaUdles  mre  recoded  the  variable  set 
was  reduced  by  combining  the  following  variables  into  interaction 
variables:  SOWSDISP,  SONRCWP,  and  SONRCBP  were  combined  into  the 
variable  MSOHSIMT;  and  BVSDXSP,  EVRCHP,  and  EVRCBP  were  combined  into 
the  variable  MEVSZNT.  The  combining  of  variables  through  this  approach 
enabled  the  effect  of  each  of  the  individiial  variables  to  be  included 
(albeit  to  a  lesser  extent) ,  while  reducing  the  number  of  variadsles  in 
the  variable  set.  These  two  interaction  variadsles  had  been  included  in 
the  stepwise  regression  analyses,  amd  were  found  to  be  significant 
(a«0.l)  (refer  Appendix  J) . 

After  the  interaction  terms  were  generated,  the  variable- set  was 
still  too  large;  hence,  it  was  necessary  to  drop  a  nximber  of  variables 


from  the  analysis.  A  decision  was  taken  to  drop  the  following 
variables:  D_DP,  PROOOPT,  and  COMPLEX.  These  three  variables  were  all 
project-characteristic  variables  which  had  been  included  in  the  variaUtsle 
set  to  act  as  moderators.  The  first  tvio  variables  were  found  to  be  of 
little  significance  in  the  stepwise  analyses,  and  the  third  variable, 
COMPLEX,  was  a  transformation  of  tJCOSTCD;  hence,  the  same  information 
was  effectively  contained  in  the  variable  set  twice. 

After  the  variable  set  vras  reduced,  the  final  step  was  to  rename  a 
number  of  variables  to  enable  the  full  complement  of  20  unforced 
variables  to  fit  in  the  appropriate  data  field  in  Statistix  4.0.  The 
new  names  appear  in  J^pendix  M;  hovrever,  the  discussion  of  the  results 
utilizes  the  original  names. 

Discussion  of  the  Results.  The  results  for  the  individual 
regression  runs  are  given  in  i^ppendix  M,  and  these  results  are 
summarized  in  Table  4-4  for  the  analyses  which  utilized  SCHEDPER  as  the 
dependent  variable,  and  in  Table  4-5  for  the  analyses  which  utilized 
SCHEDMOD  as  the  dependent  variable.  Note  that  each  model  reported  in 
the  two  tables  had  a  significant  value  for  the  overall  F  test  (a«0.0S), 
yet  within  each  model  the  p-value  for  the  t  test  for  each  variable  was 
not  always  significant  (a-0.10).  This  second  distinction  is  the  focus 
of  the  discussion  to  follow. 

The  best  subsets  regressions  identified  the  following  variad}les  as 
significant  (aaO.lO) : 

a.  NOECPS, 

b.  PLPRESCH, 

c.  PLCONC, 

d.  TDBFM, 

e.  PLNBSDEV, 

f.  NODIDS, 

g.  NOPMDIDS, 


i.  CTYPB,  and 

h.  PLNL3M. 

Of  these  variables,  TDBFM,  PLWBSDBV,  PLMI,3M,  NOPMDZDS,  MODZDS,  and  CTYPB 
were  not  identified  as  significant  in  the  stepwise  regression  amalyses. 
Furthermore,  the  appearance  of  1K)ECPS,  PLPRBSCB,  and  PLCGNC  variaUbles  in 
the  best  svibsets  models  provided  significant  support  for  the  results 
obtained  from  the  stepwise  regression  amelyses.  Bach  of  these  variables 
will  be  discussed  in  the  following  paragraphs. 

WOBCPS .  The  results  of  the  best  stibsets  regressions  lent 
considerable  support  to  the  previous  result  that  the  number  of  contract 
modlfisatlons  was  the  most  significant  variable  in  this  analysis. 
Interestingly,  this  variable  appeared  in  all  of  the  best  siibsets  models. 

PLPRBSCH .  As  for  NOBCPS,  the  results  of  the  best  subsets 
regressions  lent  considerable  support  to  the  previous  result  that  the 
pre- scheduling  of  a  contract  was  a  very  significant  varieOsle  in  this 
analysis.  Interestingly,  this  variable  appeared  in  the  majority  of  the 
best  subsets  models. 

PLCOWC .  While  not  discussed  as  a  significant  variable 
during  the  stepwise  regression  analyses,  PLCQNC  was  entered  into  the 
model  for  SCHEOPER  (without  interactions)  at  Step  #3  (refer  Appendix  H) , 
and  was  included  in  the  final  model  for  SCHBDMOD  (with  interactions)  as 
an  interaction  term  with  NOBCPS  (refer  J^pendices  K  emd  L) .  The  results 
of  the  best  subsets  regressions,  therefore,  revealed  that  concurrency  in 
a  program  was  a  significant  variable  for  defining  schedule  performance. 
The  average  coefficient  for  this  varieUale  was  approximately  23,  which 
indicated  that  a  program  that  involved  conciirrency  would  result  in 
approximately  23  percentage  units  worse  schedule  performance  tlum  a 


Table  4-4.  Results  of  Best  Subsets  Regressions  for  SCHEDPER 


Mo4el 

Ho 

Var  #1 
(p-val) 

Var  #2 
(p-val) 

Var  #3 
(p-val) 

Var  #4 

(p-val) 

P 

value 

P" 

value 

1 

HOECPS 

(.0074) 

PLPRESCH 

(.0060) 

TDEFM 

(.0345) 

.3959 

6.24 

.0034 

2 

PLPRESCH 

(.0365) 

PLNBSDEV 

(.0500) 

.3771 

5.84 

.0046 

3 

NOECPS 

(.0020) 

PLCQNC 

(.0399) 

PLNBSDEV 

(.0039) 

.3724 

5.75 

.0049 

4 

NOECPS 

^.0035) 

PLffBSOEV 

(.0116) 

TDEFM 

(.0508) 

.3599 

5.50 

.0060 

5 

NOECPS 

(.0142) 

PLPRESCH 

(.0174) 

OCOSTCD 
( .1430) 

.3234 

4.82 

.0104 

6 

NOECPS 

(.1199) 

PLPRESCH 

(.0170) 

PLDRRPP 

(.1506) 

.3208 

4.78 

.0108 

7 

NOECPS 

(.0074) 

PLWBSDEV 

(.0086) 

NOPMDIDS 

(.1297) 

.3107 

4.61 

.0125 

8 

NOECPS 

(.0307) 

PLPRESCH 

(.0241) 

PLTRM 

(.2040) 

.3056 

4.52 

.0135 

9 

NOECPS 

(.0520) 

PLPRESCH 

(.0211) 

MSOWSINT 

(.2223) 

.3014 

4.45 

.0143 

10 

NOECPS 

(.0645) 

PLPRESCH 

(.0110) 

PLAGGR 

(.2290) 

.3000 

4.43 

.0146 

11 

NOECPS 

(.0011) 

PLPRESCH 

(.0081) 

PLWBSDEV 

(.0153) 

TDEFM 

(.0109) 

.5307 

7.78 

.0006 

12 

NOECPS 

(.0015) 

PLPRESCH 

(.0321) 

PLCONC 

(.0349) 

PLWBSDEV 

(.0067) 

.4793 

6.52 

.0016 

13 

NOECPS 

(.0072) 

PLPRESCH 

(.0117) 

PLWL3M 

(.0965) 

TDEFM 

(.0132) 

.4494 

5.90 

.0026 

14 

NOECPS 

(.0046) 

PLPRESCH 

(.0064) 

PLTRM 

(.1280) 

TDEFM 

(.0248) 

.4367 

5.65 

.0033 

15 

NOECPS 
( .0117) 

PLPRESCH 

(.0024) 

PLAGGR 

(.1404) 

TDEFM 

(.0246) 

.4326 

5.57 

.0035 

16 

NOECPS 
( .0028) 

PLPRESCH 

(.0051) 

UCOSTCD 

(.1417) 

TDEFM 

(.0365) 

.4322 

5.57 

.0035 

17 

NOECPS 

(.0153) 

PLPRESCH 

(.0301) 

PLWBSDEV 

(.0449) 

PLDRRFP 

(.1266) 

.4197 

5.34 

.0043 

Table  4-5.  Results  of  Best  Subsets  Regressions  for  SCHEDMOD 


Model 

NO 

Var  il 
(p-val) 

Var  #2 
(p-val) 

Var  #3 
(p-val) 

Var  #4 

(p-ral) 

1 

NOBCPS 

(.0000) 

PLPRESCH 

(.0000) 

PLCONC 

(.0052) 

2 

NOECPS 

(.0000) 

PLPRESCH 

(.0000) 

TDBPM 

(.0095) 

3 

NOECPS 

(.0000) 

PLPRESCH 

(.0015) 

NOPMDZOS 

(.0491) 

4 

NOECPS 

(.0000) 

PLPRESCH 

(.0001) 

NODZDS 

(.0496) 

5 

NOECPS 

(.0000) 

PLPRESCH 

(.0001) 

CTYPE 

(.0941) 

6 

NOECPS 

(.0000) 

PLPRESCH 

(.0002) 

SOHCSSR 

(.1131) 

7 

NOECPS 
( .0000) 

PLPRESCH 

(.0002) 

PAGESSOW 

(.1956) 

8 

NOECPS 

(.0000) 

PLPRESCH 

(.0000) 

PLCONC 

(.0447) 

TDEFM 

(.0821) 

9 

NOECPS 

(.0000) 

PLPRESCH 

(.0001) 

PLCONC 

(.0032) 

NOEVCRIT 

(.1805) 

10 

NOECPS 

(.0000) 

PLPRESCH 
( .0000) 

CTYPE 

(.1069) 

TDEFM 

(.0120) 

11 

NOECPS 

(.0000) 

PLPRESCH 

(.0000) 

TDEFM 

(.0104) 

SOWCSSR 

(.1081) 

12 

NOECPS 

(.0000) 

PLPRESCH 

(.0000) 

PLCONC 

(.0104) 

SOHCSSR 

(.2110) 

13 

NOECPS 

(.0000) 

PLPRESCH 

(.0003) 

PLCONC 

(.0224) 

NOPMDIDS 

(.2203) 

14 

NOECPS 

(.0000) 

PLPRESCH 

(.0002) 

TDEPM 

(.0236) 

NOPMDIDS 

(.1195) 

m 

F 

▼alue 

P- 

value 

.8550 

44.25 

.0000 

.8464 

41.42 

.0000 

.8208 

34.60 

.0000 

.8207 

34.56 

.0000 

.8102 

32.30 

.0000 

.8072 

31.70 

.0000 

.7982 

30.00 

.0000 

.8712 

38.21 

.0000 

.8619 

35.32 

.0000 

.8603 

34.86 

.0000 

.8601 

34.82 

.0000 

.8601 

34.80 

.0000 

.8596 

34.66 

.0000 

.8588 

34.46 

.0000 

program  that  did  not  involve  concurrency. 

TDBPM.  While  not  discnissed  as  a  significant  variable  during 
the  stepwise  regression  ainalyses,  the  ordinal -level  version  of  TDBFM 
(TBCHDBFN)  was  entered  into  the  model  for  SCHBDMOO  (without 
interactions)  at  Step  #3  (refer  Appendix  I) ,  was  entered  into  the  model 
for  SCHBDPBR  (with  interactions)  at  Step  #6  (refer  J4>pendix  J) ,  auad  was 
included  in  the  model  for  SCHEDMOD  (with  interactions)  at  Step  #4  (refer 
Appendix  K) .  Interestingly,  TDBFM  appeared  in  almost  half  of  the  best 
subsets  models.  The  results  of  the  best  subsets  regressions,  therefore, 
revealed  that  the  degree  of  technical  definition  was  a  significant 
variable  for  defining  schedule  performance.  The  average  coefficient  for 
this  variable  was  approximately  20,  which  indicated  that  a  program  that 
utilized  a  Type  B  specification  (either  draft  or  full)  would  result  in 
approximately  20  percentage  units  worse  schedule  performance  than  for  a 
program  that  utilized  a  Type  A  specification  (either  draft  or  full) . 

PLWBSDEV.  Interestingly,  during  the  stepwise  analyses, 
PLWBSDEV  was  not  entered  into  any  of  the  stepwise  regression  models  for 
SCHBDPBR  nor  for  SCHETOIOD.  With  respect  to  the  best  subsets 
regressions,  on  the  other  hand,  PLWBSDEV  appeared  in  almost  half  the 
models  obtained  for  SCHBDPBR,  though  did  not  appear  in  any  of  the  models 
for  SCHEDMOD.  The  results  of  the  best  subsets  regressions,  therefore, 
revealed  that  the  development  of  a  preliminary  WBS  was  a  marginally 
significant  varicdile  for  defining  schedule  performamce.  The  average 
coefficient  for  this  variable  was  approximately  -86;  however,  with  a 
standard  error  of  approximately  30,  the  magnitude  of  this  coefficient 
should  be  treated  with  caution.  The  sign  of  the  coefficient,  however. 


Indicated  that  the  development  of  a  preliminary  WBS  would  in^rove 
schedule  performance. 

NODIDS .  While  not  discussed  as  a  significant  variad^le 
during  the  stepwise  regression  analyses,  NODIDS  was  entered  into  the 
model  for  SCHEEMOD  (without  interactions)  at  Step  #4  (refer  Appendix  I) , 
and  was  entered  into  the  model  for  SCHEDMOD  (with  interactions)  at 
Step  #5  (refer  Appendix  K) .  With  respect  to  the  best  subsets 
regressions,  however,  NODIDS  appeared  in  only  one  of  the  models  obtained 
for  SCHEDMOD.  In  all  of  the  three  cases  mentioned  here,  the  coefficient 
for  this  variable  was  approximately  0.4,  which  indicated  that  as  the 
number  of  DIDS  for  a  program  were  increased,  schedule  performance  would 
worsen  at  the  rate  of  0.4  percentage  units  per  DID.  Given  that  this 
variable  only  appeared  in  one  of  the  best  stibsets,  however,  this  result 
should  be  treated  with  caution. 

NOPMDIDS .  During  the  stepwise  analyses,  NOPMDIDS  was  not 
entered  into  any  of  the  stepwise  regression  models  for  SCHEDPER  or  for 
SCHE^OD.  Furthermore,  with  respect  to  the  best  subsets  regressions, 
NOPMDIDS  appeared  as  a  significant  variable  in  only  one  of  the  models 
obtained  for  SCHEDMOD  (a>0.1) .  The  variadsle  did  appear  in  a  number  of 
other  models;  however,  the  associated  p- value  was  greater  than  0.1.  The 
variability  explained  by  NOPMDIDS,  therefore,  was  better  explained  by 
other  variables  in  the  variable  set.  On  this  basis,  NOPMDIDS  was  not 
considered  to  be  significeuitly  related  to  schedule  perfornieuice,  in 
conparison  with  the  already  identified  significant  variables. 

CTYPB.  During  the  stepwise  euialyses,  CTYPE  was  not  entered 
into  any  of  the  stepwise  regression  models  for  SCHEDPER  nor  for 
SCHEDMOD.  Furthermore,  with  respect  to  the  best  subsets  regressions, 
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CTYPB  appeared  in  only  one  of  Che  models  obtained  for  SCHEDMOD.  In  Chat 
model,  CTYPB  had  a  p-value  of  0.0941,  which  was  very  close  Co  a«0.l. 

For  these  reasons,  CTYPB  was  not  considered  Co  be  a  variable  which 
meaningfully  contributed  to  the  explanation  of  schedule  performance. 

PLWL3M .  During  the  stepwise  analyses,  the  ordinal -level 
version  of  PIiWL3M  (PIiWBSIj3)  was  not  entered  into  any  of  the  stepwise 
regression  models  for  SCHEDPBR  or  for  SCHEI»10D.  Furthermore,  with 
respect  to  the  best  .subsets  regressions,  PLWL3M  appeared  in  only  one  of 
the  models  obtained  for  SCHEOPER.  In  that  model,  PLWL3M  had  a  p-value 
of  0.0965,  which  was  very  close  to  a>0.1.  For  these  reasons,  PLWL3M  was 
not  considered  to  be  a  variable  which  meaningfully  contributed  to  the 
explanation  of  schedule  performance. 

Summary  of  Best  Subsets  Regression.  Best  subsets  regression  was 
utilized  to  aid  in  the  identification  of  important  pre-contract -award 
rtianagement  actions  which  may  affect  schedule  performance.  A  number  of 
additional  actions  were  identified  by  best  subsets  regression  which  had 
not  been  identified  in  Che  stepwise  regression  analyses,  and  the 
relevance  of  these  actions  was  discussed.  The  use  of  best  subsets 
regression,  therefore,  enabled  the  nature  of  schedule  performance  and 
schedule  management  to  be  better  understood. 


Diacuasion  of  the  Results 


Introduction 

Chapter  I  of  the  thesis  outlined  the  specific  problem  addressed  by 
this  research  effort  and  presented  the  associated  investigative 
questions.  This  section  of  Chapter  IV  will  discuss  the  results  of  the 
amalyses  in  relation  to  the  investigative  questions.  Specifically,  this 
section  will  address,  as  appropriate: 

a.  the  variables  which  were  found  to  be  significant  from  the 
single- variaible  analyses, 

b.  the  variables  which  were  foimd  to  be  significant  from  the 
multi-variable  analyses, 

c.  some  observations  associated  with  the  variables  which  were 
found  to  be  significant,  and 

d.  some  observations  associated  with  the  variables  which  were 
found  not  to  be  significant. 

For  reasons  that  will  become  immediately  obvious,  a  brief  discussion  of 
the  results  of  the  analyses  for  the  variables  not  covered  \inder  any  of 
the  investigative  questions  is  required  before  the  investigative 
questions  are  addressed. 

Significant  Results  Outside  the  Scope  of  the  Investigative  Questions 

A  number  of  the  variables  included  in  the  analyses  were  not 
addressed  by  the  investigative  questions.  These  variables  included  a 
number  of  project-characteristic  variables  (i.e..  Contract  Type  (CTYPB) , 
Development  /  Development  and  Production  (D_DP) ,  Production  Option 
(PRODOPT) ,  unit  Cost  in  Constant  Dollars  (UCOSTCD) ,  and  Con^lexity 
(COMPLEX) )  and  a  moderator  variable  to  address  the  post -contract -award 


management  actions:  Number  of  Contract  Modifications  (NOECPS) .  Of  the 
project-characteristic  variables,  D_DP,  PRODOPT,  UCOSTCD,  and  COMPLEX 
demonstrated  a  significant  relationship  with  schedule  performance  at  the 
single-variable-analysis  level  (a>0.2S}.  At  the  multi-variable-analysis 
level,  however,  none  of  these  variables  trere  found  to  be  significant 
(a>0.1}.  NOECPS,  on  the  other  hand,  was  arguably  the  most  significant 
main  effect  and  interacting  variable  at  all  levels  of  the  auialysis. 

This  result  was  not  unexpected,  and  reinforces  the  commonly-held  belief 
that  post-contract-award  actions  are  the  main  drivers  of  schedule 
performance.  Furthermore,  this  result  is  arguably  the  most  important 
contribution  of  this  research  effort  to  an  understanding  of  schedule 
performance;  hence,  a  study  of  the  relationship  between  pre-contract- 
award  management  actions  and  the  resultant  number  of  contract  changes  is 
worthy  of  some  endeavor.  This  additional  study,  however,  was  outside  of 
the  scope  of  the  research  effort. 

Investigative  Question  One 

The  first  investigative  question  was  as  follows:  Which  management 
actions,  with  the  potential  to  affect  schedule  performance,  may  occur 
prior  to  contract  award?  This  investigative  question  was  addressed 
through  the  literature  review  in  Chapter  II  of  the  thesis.  A  review  of 
current  DoD  policies  and  procedures  resulted  in  the  camdidate  varieUsle 
list,  attached  at  Appendix  B,  which  was  refined  to  obtain  the  DCI. 

Investigative  Question  Two 

The  second  investigative  question  was  as  follows:  Which  DoD 
management  actions,  during  the  planning  phase,  influence  schedule 
performance?  The  results  from  both  the  single-varicdsle  and  the  multi- 
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variable  analyses  showed  that  a  number  of  planning  actions  have  the 
potential  to  affect  schedule  performance.  Prom  the  single- variable 
analyses,  the  following  variables  were  fo\md  to  have  at  least  some 
relationship  to  schedule  performance,  at  the  broad  level  of  significance 
chosen  (a-0.25) :  Pre-scheduled  (PLPRBSCH) ,  Schedule  Risk  (PliSRZSK) , 
Preliminary  MBS  Developed  (PLNBSDBV) ,  Number  of  Elements  at  Level  Three 
of  the  WBS  (PLNBSL3) ,  and  Draft  RFP  (PLDRRFP) .  The  multi -variable 
analyses  revealed  that  the  following  planning  variables  were  significant 
(a*0.1) :  Pre-scheduled  (PLPRBSCH),  Concurrency  (PLCONC) ,  and 
Preliminary  WBS  Developed  (PLWBSDEV) . 

As  expected,  the  planning  variables  that  were  found  to  be 
significant  at  the  single-variable-analysis  level  were  not  necessarily 
foimd  to  be  significant  at  the  multi-variable-analysis  level.  In  part, 
this  was  due  to  the  less  stringent  level  of  significance  utilized  at  the 
single-variable-analysis  level,  and  that  collinearities  and  potential 
interactions  were  not  considered  at  that  level.  Furthermore,  this 
result  was  an  artifact  of  the  model-building  process  itself,  in  that 
only  a  maximum  of  four  variables  could  be  meaningfully  enployed  in  emy 
multiple  regression  model. 

Of  the  three  planning  variables  identified  at  the  multi-variable- 
analysis  level,  Pre-scheduled  (PLPRBSCH)  and  Concurrency  (PLCONC)  were 
found  to  be  the  most  significant  variad>les.  Interestingly  euid  perhaps 
cotmter- intuitively,  Pre-scheduled  (PLPRBSCH)  was  discovered  to  have  a 
beneficial  effect  on  schedule  performance;  that  is,  a  contract  that  was 
pre-scheduled  by  the  DoD  resulted  in  a  better  schedule  performance. 
Concurrency,  on  the  other  hand,  appealed  to  intuitive  sense  in  that  it 
was  found  to  have  a  detrimental  effect  on  schedule  performance;  that  is. 
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the  existence  of  concurrency  resulted  in  a  worse  schedule  performance. 
With  respect  to  Preliminary  WBS  Developed  (PLWBSDEV) ,  a  tentative 
result,  based  on  the  sign  of  the  associated  coefficient,  was  that,  the 
development  of  a  preliminary  WBS  %#ould  have  a  beneficial  effect  on 
schedule  performance. 

Two  of  the  variables  that  were  found  to  be  significant  at  the 
single -variable  analysis  stage  (a«0.2S)  but  were  not  found  to  be 
significant  at  the  multi -variable  stage  (a>0.1)  require  further 
discussion:  Schedule  Risk  (PliSRISR)  amd  Draft  RFP  (PLDRRFP)  .  The  fact 
that  Schedule  Risk  (PLSRISK)  was  not  found  to  be  significauit  at  the 
multi-variable  analysis  stage  is  important  because  this  result 
highlights  the  difficulties  associated  with  the  a  priori  assessment  of 
schedule  risk.  With  regard  to  Draft  RFP  (PLDRRFP) ,  the  lack  of  a  very 
significant  relationship  between  whether  or  not  a  draft  RFP  was  issued 
and  schedule  performance  is  important  because  this  result  is  counter¬ 
intuitive.  These  results,  however,  do  not  provide  definitive  proof  that 
these  variables  are  not  related  to  schedule  performance;  the  lack  of  a 
very  significant  relationship  could  be  due  to  the  sample  size  amd  to 
artifacts  of  the  sample. 

The  study  of  the  relationship  between  pre-contract -award 
management  actions  and  the  resultant  schedule  performance  would  not  be 
complete  without  addressing  which  actions  did  not  result  in  a 
significant  relationship  at  any  auialysis  level.  With  respect  to  the 
planning  variables,  the  following  variables  did  not  exhibit  a 
significant  relationship  with  schedule  performance:  Aggressive  (PLAGGR) 
and  Technical  Risk  (PLTRISK) .  Within  the  limitations  of  this  thesis, 
the  lack  of  a  relationship  between  these  varieUsles  and  schedule 


performance  is  surprising:  PLAGGR  because,  intuitively,  an  admittedly 
aggressive  schedule  would  be  expected  to  result  in  a  schedule  overrun 
(unless  additional  schedule -management  actions  were  to  counteract  the 
overrun  potential);  and  PLTRZSK  because  previous  studies  (e.g.,  the  1990 
RAND  study)  have  linked  technical  uncertainty  with  schedule  overrun. 

Investigative  Question  Three 

The  third  investigative  question  was  as  follows:  which  DoD 
management  actions,  during  the  specif ication-of- requirements  phase, 
influence  schedule  performance?  The  results  from  both  the  single¬ 
variable  and  the  multi-variable  analyses  showed  that  a  numlaer  of 
specifying  actions  have  the  potential  to  affect  schedule  performance. 
Prom  the  single- variable  analyses,  the  following  variables  were  found  to 
have  at  least  some  relationship  to  schedule  performance  at  the  broad 
level  of  significance  chosen  (0*0.25):  Degree  of  Technical  Definition 
(TECRDEFN) ,  Develop  WBS  Further  (SOWDWBS) ,  and  SOW  Schedule  Display 
(SOWSDISP) .  The  multi -variable  analyses  revealed  that  the  following 
specifying  variatbles  were  significant  (a«0.1):  Technical  Definition 
(TDEFM)  (i.e.,  TECHDEFN  recoded  as  a  binary  variable);  SOW  Schedule 
Display  (SOWSDISP) ;  Number  of  DIDs  (NODIDS) ,  SOW  Resource  Constraints 
Within  a  Program  (SOWRCWP)  (as  an  interacting  variable  with 
Pre-scheduled  (PliPRBSCH) ) ;  and,  as  a  three-way  interaction  variable: 

SOW  Schedule  Display  (SOWSDISP) ,  SOW  Resource  Constraints  Within  a 
Program  (SOWRCWP) ,  and  SOW  Resource  Constraints  Between  Programs 
(SOWRCBP) . 

Of  the  five  specifying  variables  identified  at  the  multi-variable- 
amalysis  level.  Technical  Definition  (TDEFM) ,  SOW  Schedule  Display 


(SOWSDISP) ,  and  Number  of  DIDs  (NODIDS)  were  found  to  be  the  most 
significant  variables.  The  degree  of  technical  definition  was  found  to 
have  a  detrimental  effect  on  schedule  performance,  in  that,  as  the 
specification  changed  from  a  functional  specification  (i.e..  Type  A)  to 
a  Prime  Item  Development  Specification  (PIDS)  (i.e..  Type  B) ,  schedule 
performance  worsened.  The  format  in  which  the  schedule-performance 
information  was  requested  in  the  SON  was  found  to  have  a  beneficial 
effect  on  schedule  performance,  in  that,  a  program  that  requested 
information  in  a  netvrork  format  had  inqproved  schedule  performance 
coiiq>ared  with  a  program  that  requested  information  in  a  Gantt  chart 
format.  The  number  of  DIDs  was  found  to  have  a  detrimental  effect  on 
schedule  performance,  in  that,  as  the  number  of  DIDs  for  a  program 
increased,  schedule  performance  %irorsened. 

The  other  two  variables  also  found  to  be  significamt  at  the  multi¬ 
variable-analysis  level,  SONRCNP  and  SOWRCBP,  were  only  significant  as 
interaction  variables.  With  respect  to  the  interaction  varieUsle 
involving  SOWRCWP  and  PLPRESCH,  this  variable  demonstrated  that  if  a 
contract  were  pre-scheduled  and  if  the  SOW  required  that  resource 
constraints  within  a  program  be  evaluated,  then  these  two  actions, 
together,  would  have  a  beneficial  effect  on  schedule  performance.  As 
discussed  earlier  in  this  Chapter,  the  significance  of  the  three-way 
interaction  term,  MSOWSINT  (SOWSDISP*SOWRCWP*SOWRCBP} ,  was  believed  to 
be  due  to  an  artifact  of  the  sanqile.  For  this  reason,  the  significance 
of  MSOWSINT  and,  therefore,  SOWRCBP,  are  questionable.  The  inclusion  of 
the  interaction  terms  in  that  multiple  regression  model  reinforces  the 
need  to  evaluate  real-world  scenarios  from  a  multi -variable  perspective. 


Th«  study  of  the  relationship  between  pre-contract -award 
managesient  actions  and  the  resultant  schedule  performance  would  not  be 
complete  without  addressing  which  actions  did  not  result  in  a 
significant  relationship  at  any  stage  of  the  analysis.  With  respect  to 
the  specifying  variables,  the  following  variables  did  not  exhibit  a 
significant  relationship  with  schedule  performance:  Number  of  Pages  in 

the  SON  (PAGBSSOW) ,  Develop  WBS  Further  (SONDNBS) ,  C/SSR  Required 
(SOWCSSR) ,  Frequency  of  Reporting  Schedule -Management  Information 
(SOWFRSI) ,  and  Number  of  Project -Management  DIDs  (NOPMDIDS) .  Within  the 
limitations  of  this  thesis,  the  lack  of  a  relationship  between  the  last 
four  (which  are  the  intuitively  significant  variables)  and  schedule 
performance  was  sxirprising  and,  potentially,  of  considerable  import. 

Investigative  Question  Four 

The  fovirth  investigative  question  was  as  follows:  Which  DoO 
management  actions,  during  the  evaluation  phase,  influence  schedule 
performance?  The  results  from  both  the  single-variad>le  and  the  multi- 
variaUsle  auialyses  showed  that,  within  the  constraints  of  the  sanple 
size,  evaluating  actions  «rere  not  related  to  schedule  performance.  From 
the  single- variable  analyses,  one  variable  was  foxmd  to  have  a  minor 
relationship  to  schedule  performance  at  the  broad  level  of  significance 
chosen  (a>0.25) :  Evaluation  Schedule  Display  (EVSDISP) .  The  multi- 
variable  analyses,  however,  revealed  that  none  of  the  evaluating 
variables  were  significant  (a>0.1) . 

As  a  corollary  to  the  preceding  discussion,  the  following 
evaluating  variables  did  not  exhibit  a  relationship  with  schedule 
perf omumce :  Number  of  Bvaliiation  Criteria  (NOEVCRZT)  ,  Evaluation 


Resource  Constraints  Within  a  Program  (EVRCWP) ,  and  Evaluation  Resource 
Constraints  Between  Programs  (EVRCBP) .  within  the  limitations  of  this 
thesis,  the  fact  that  evaluating  variables  were  found  to  have  little 
significance  in  defining  schedule  performance  appears  to  be  counter¬ 
intuitive  and  extremely  relevant. 

Investigative  Question  Five 

The  fifth  investigative  question  was  as  follows:  Of  the  DoD 
management  actions  which  positively  influence  schedule  performance, 
which  can  be  cost-effectively  iRq)lemented  (comnensurate  with  the 
selected  project  characteristics)?  Due  to  the  small  sample-size,  the 
ability  of  regression  techniques  to  conprehensively  evaluate  the  large 
number  of  variables  involved  was  limited.  From  this  perspective, 
therefore,  the  ability  to  address  this  investigative  c[uestion  was  also 
limited.  The  results  obtained  under  investigative  questions  two,  three, 
and  four  provide  some  tentative  guidance  as  to  the  focus  of  management 
attention.  The  management  actions  identified  under  those  investigative 
questions  are  all  able  to  be  inplemented  with  little  effort  and  for 
little  cost  by  both  the  DoD  and  the  contractor;  hence,  these  actions  are 
considered  to  be  cost-effective. 

Other  Observations  Related  to  Schedule  Management 

A  number  of  observations  were  made  during  the  data -col lection 
process  and  during  the  initial  data  analysis  which  highlight  some 
important  issues  with  resi>ect  to  schedule  management.  These 
observations  imply  that  the  management  of  schedule,  via  the  contractual 
process,  is  not  %irell  understood  within  the  SPO.  The  specific 


observations  which  support  this  conclusion  are  discussed  in  the 
following  paragraphs. 

Schedule-Management  Information.  The  information  that  was 
required  for  the  assessment  of  schedule  during  source  selection  (i.e., 
in  the  ITO)  often  differed  from  the  information  that  was  required  for 
the  management  of  schedule  throughout  the  contractual  period  (i.e.,  in 
the  SOW  and  the  CDRL) .  For  example,  12  of  the  29  contracts  in  the 
database  differed  from  the  ITO  to  the  SOW/CDRL  with  respect  to  the 
format  in  which  the  schedule-management  information  was  required  to  be 
presented  (i.e.,  Gantt  chart  or  network).  Furthermore,  12  of  the  29 
contracts  differed  from  the  ZTO  to  the  SOW/CDRL  as  to  whether  or  not 
resource  constraints  within  a  program  were  to  be  evaluated,  and  13  of 
the  29  contracts  differed  from  the  ITO  to  the  SOW/CDRL  as  to  whether  or 
not  resource  constraints  between  programs  were  to  be  evaluated. 

The  information  that  was  required  for  the  management  of  schedule 
throughout  the  contractual  period  was  rarely  found  to  be  specified  in  a 
coherent  «uid  integrated  manner.  In  a  significant  number  of  contracts, 
the  schedule-presentation  information,  the  evaluation  of  resource 
constraints,  and  the  allocation  of  responsibility  were  all  specified  in 
different  sections  of  the  contract.  Furthermore,  many  of  the  project- 
nuuiagement  DZDs  ioqposed  unique  schedule -management  requirements  that 
were  not  necessarily  cooqpatible  with  each  other  nor  with  the  major 
schedule -management  requirements  for  a  particular  contract. 

Significance  of  the  Work  Breakdown  Structure.  For  a  number  of 
contracts  in  the  database,  the  manner  in  which  the  WBS  was  specified 
implied  that  the  WBS  was  not  being  effectively  utilized  for  the 
management  of  schedule.  In  many  contracts  examined  during  the  data- 


collection  process,  the  SOW  required  that  the  WBS  be  periodically 
updated  throughout  the  life  of  the  contract  without  tying  the 
requirement  for  a  WBS  to  any  other  requirement  in  the  contract. 
Furthermore,  three  of  the  RFPs  which  did  not  include  a  preliminary  WBS 
required  that  the  resultant  contractor  utilize  a  WBS  for  contract- 
management  purposes.  Moreover,  ttra  of  the  RFPs  which  required  that  the 
offeror  update  the  preliminary  WBS  with  his/her  proposal  did  not  rec[uire 
that  the  WBS  be  used  for  contract-management  purposes.  Finally,  the 
preliminary  WBS  was  often  'hidden'  in  the  cost -requirements  section  of 
the  ZTO,  which  implied  that  the  WBS  was  considered  by  the  SPO  to  be  more 
relevant  for  cost-accounting  purposes  than  for  the  management  of 
schedule.  These  practices  suggest  that  the  effectiveness  of  the  WBS  as 
a  schedule -management  tool  may  not  be  well  imderstood. 

Integration  of  C/SCSC  or  C/SSR  with  Network  Information.  None  of 
the  contracts  in  the  database  atten^ted  to  integrate  C/SSR  or  C/SCSC 
requirements  with  network  information.  Furthermore,  the  guidance 
concerning  the  use  of  C/SCSC,  in  comparison  with  C/SSR,  appeared  to  be 
inappropriately  applied  at  times  (i.e.,  C/SCSC  was  specified  for  some 
contracts  with  a  face  value  (or  potential  worth)  significantly  below  the 
mandated  threshold) .  The  potential  gains  of  an  integrated  approach  to 
cost  and  schedule  management,  therefore,  were  not  realized. 

Schedule  Risk.  A  significauit  observation  from  the  contracts  in 
the  database  was  that  only  one  of  the  contracts  had  a  schedule- risk 
assessment  of  high  and  only  one  of  the  contracts  had  a  schedule-risk 
assessment  of  medium-high,  while  the  rest  of  the  contracts  had  a 
schedule  risk  assessment  of  medium  or  lower.  Given  that  23  of  the  25 


contracts  in  the  san^le  experienced  a  schedule  overrun,  the  implication 


of  this  result  is  that  the  assessment  of  schedule  risk  by  the  SPOs  does 
not  reflect  an  adequate  understanding  of  the  factors  that  affect 
schedule  performance. 

Reactive  Nature  of  Schedule  Management.  For  the  29  contracts  in 
the  database,  only  one  of  the  contracts  required  that  the  schedule- 
management  information  be  provided  proactively  (i.e.,  as  schedule 
slippage  was  foreseen) .  For  the  remaining  28  contracts,  the  schedule- 
management  information  was  provided  either  on  a  regular  basis  (e.g., 
monthly)  or  as  slippage  occurred;  hence,  the  management  of  schedule  was 
only  able  to  be  conducted  reactively. 

Use  of  Schedule -management  Techniques.  A  significant  number  of 
schedule -management  techniques  exist,  some  of  which  were  outlined  in 
Chapter  II.  For  the  contracts  in  the  dataloase,  however,  only  limited 
use  was  made  of  the  most  basic  techniques.  The  potential  benefits  of 
the  more  sophisticated  techniques  such  as  PERT,  simulation  studies,  and 
contingency  schedules,  therefore,  were  not  able  to  be  realized. 

Generation  of  Schedule-m£maQement  Requirements.  The  generation  of 
contractual  documentation  is  a  task  of  considerable  magnitude;  hence, 
during  the  data-collection  process,  it  was  not  surprising  to  discover 
that  a  degree  of  copying  from  previous  contracts  had  occurred.  The 
specification  of  the  schedule-management  requirements  should  be  based 
upon  the  char2.cteristics  of  each  contract.  With  respect  to  the 
contracts  in  the  database,  therefore,  the  copying  of  requirements  from 
previous  contracts  had  sometimes  led  to  the  inappropriate  specification 
of  schedule-management  requirements  within  the  contractual 


documentation . 


Suroroarv 


'  This  section  of  Chapter  IV  has  sunonarized  the  results  of  the 
analyses  and  addressed  the  investigative  questions.  The  Nvunber  of 
Contract  Modifications  (NOECPS)  variable  was  found  to  be  the  most 
signific^mt  variable  in  terms  of  defining  schedule  performance.  With 
respect  to  the  planning,  specifying,  2md  evalxiating  phases  of  the 
contractual  process,  the  variables  which  were  found  to  be  significemt  in 
these  areas  were  discussed.  Furthermore,  and  equally  importamt,  the 
variables  which  were  found  not  to  be  significant  were  also  discussed. 
Finally,  some  observations  related  to  schedule -management  practices 
within  the  SPOs  were  highlighted  which  have  some  importamt  implications 

e 

for  the  management  of  schedule. 

The  adsility  to  generalize  these  results  was  limited  by  the  thesis 
constraints;  that  is,  by  the  choice  of  project  characteristics  to  define 
the  sample,  and  by  the  small  sairple-size.  Some  tentative  conclusions 
may  be  drawn,  however,  and  the  signif icauice  of  these  will  be  discussed 
in  Chapter  V. 


Chapter  Summary 

This  chapter  has  presented  the  detailed  analysis  of  the  data.  The 
auialysis  results  discussed  in  the  chapter  provided  consideradsle  insight 
into  the  relationships  between  the  pre-contract -award  mauiagement  actions 
and  schedule  performance.  The  s ingle -variedsle  euialyses  showed  that  a 
number  of  varieUsles  were  related  to  schedule  performance  and  that 
proceeding  with  a  multiple  regression  model -building  stage  was 
appropriate.  The  results  from  the  multi-variable  analyses  revealed  that 


4-75 


the  Nvunber  of  Contract  Modifications  (NOECPS)  variable  was  the  most 
significwt  variable  in  terms  of  defining  schedule  performance;  however, 
a  number  of  other  variables  were  also  significant:  Pre-scheduled 
(PliPRESCH) ,  Concurrency  (PLCONC) ,  Preliminary  WBS  Developed  (PLWBSDEV) , 
Degree  of  Technical  Definition  (TDEFM) ,  SOW  Schedule  Display  (SOWSDISP) , 
and  Number  of  DIDs  (NODZDS) .  The  results  from  the  multi -variable 
analyses  also  revealed  that  a  number  .of  varicdsles  did  not  play  a  direct 
role  in  defining  schedule  performance;  instead,  these  variad3les  become 
significant  when  interacting  with  other  variables.  Furthermore,  the 
variables  that  did  not  show  a  significant  relationship  with  schedule 
performance  were  also  addressed.  Finally,  some  observations  related  to 
schedule-mauiagement  practices  within  the  SPOs  were  discussed.  Chapter  V 
will  present  a  summary  of  the  thesis  so  far,  will  discuss  the 
significance  of  the  findings,  and  will  present  some  opportunities  for 


follow-on  research. 


V.  Conclusiona  and  Recowr-^  ♦dations 


Introduction 

The  first  four  chapters  of  this  thesis  have  presented  the  research 
question  amd  associated  investigative  questions,  a  sunmary  of  the 
relevant  literature,  the  development  of  the  methodology,  and  the  results 
and  findings  for  the  data  collected.  This  chapter  will  continue  the 
presentation  of  the  research  by  summarizing  what  has  occurred  so  far, 
and  by  addressing  the  conclusions  that  may  be  drawn.  Specifically,  this 
chapter  will  present: 

a.  a  summary  of  the  first  three  chapters, 

b.  a  siimmary  of  the  findings  in  Chapter  IV, 

c.  a  discussion  of  the  significance  of  the  findings  amd  the 
practical  inq>lications  of  the  research,  and 

d.  a  discussion  of  possible  follow-on  research. 

Summary  of  the  First  Three  Chapters 

Each  acquisition  contract  has  a  three-dimensional  goal:  to 
accomplish  the  requisite  work  within  specified  cost,  schedule,  amd 
performamce  requirements.  Within  the  DoD,  however,  the  typical 
acquisition  contract  is  characterized  as  being  "behind  schedule  amd  over 
budget"  (Christensen,  1993:37).  While  there  has  been  some  effort  to 
exaunine  the  reasons  for  cost  overruns,  there  has  been  little  research 
into  the  causes  of  schedule  overruns.  This  study  aimed  to  contribute  to 
the  body  of  knowledge  in  this  area  through  am  examination  of  certain 
elements  of  DoD  contracting  practices.  Specifically,  the  goal  of  this 


research  was  to  assess  the  relationship  between  pre-contract-award 


management  actions  by  the  DoD  and  the  resultant  schedule  performance. 
More  particularly,  this  research  analyzed  those  DoD  pre-contract -award 
management  actions  which  urere  believed  to  affect  the  contracted  schedule 
performance . 

Congress,  through  the  Federal  Acquisition  Regulations  (FAR) ,  and 
the  DoD,  through  numerous  directives  and  instructions,  mandate  the 
policies  and  procedures  which  will  be  followed  throughout  the 
acquisition  process.  Little  research,  ho«rever,  has  been  conducted  to 
ascertain  the  efficiency  and  effectiveness  of  these  procedures.  This 
thesis  is  a  step  towards  a  better  understanding  of  the  interactive 
nature  of  these  processes  and,  from  this  perspective  alone,  is 
considered  to  be  a  worthwhile  endeavor. 

Schedule  performance  for  the  purposes  of  this  research  was  defined 
as  the  percentage  schedule  overrun;  that  is,  the  difference  between  the 
actual  schedule  and  the  contracted  schedule,  expressed  as  a  percentage 
of  the  actual  schedule.  (By  this  definition,  therefore,  a  schedule 
underrun  results  in  a  negative  schedule  performance . )  Schedule 
performance  was  measured  as  of  the  date  that  delivery  of  the  major 
developmental  item(s) ,  \inder  the  primary  Contract  Line  Item  Number (s) 

( CLIN ( s ) ) ,  occurred . 

To  address  the  multitude  of  issues  presented  by  this  research,  the 
contractual  process  was  divided  into  four  activity  areas,  namely: 

a.  planning  the  acquisition, 

b.  specifying  the  requirement, 

c.  evaluating  the  proposal,  euid 

d.  monitoring  and  controlling  the  resultant  contract. 


While  the  last  of  these  activities  does  not  involve  pre-contract -award 
numagement  actions,  the  ad>ility  to  adequately  monitor  and  control  a 
contract  was  believed  to  be  highly  dependent  upon  consideration  of  the 
relevant  issues  during  the  planning,  specifying,  and  evaluating  phases. 

Bach  of  the  four  activity  areas  involved  specific  schedule 
management  actions  which  had  the  potential  to  affect  schedule 
performance.  To  address  the  specific  problem  from  the  perspective  of 
each  of  these  activity  areas,  therefore,  a  series  of  investigative 
questions  were  developed.  These  investigative  questions  are  listed,  as 
follows : 

a.  Which  management  actions,  with  the  potential  to  affect 
schedule  performance,  may  occur  prior  to  contract  award? 

b.  Which  DoD  management  actions,  during  the  pleuining  phase, 
influence  schedule  performance? 

c.  Which  DoD  management  actions,  during  the  specif ication-bf- 
requirements  phase,  influence  schedule  performance? 

d.  Which  DoD  management  actions,  during  the  evaluation  phase, 
influence  schedule  performance? 

e.  Of  the  DoD  management  actions  which  positively  influence 
schedule  performance,  which  can  be  cost-effectively 
implemented  (commensurate  with  the  selected  project 
characteristics) ? 

The  population  of  interest  for  this  research  was  selected  as  all 
DoD  acquisition  contracts  which  did  not  employ  C/SCSC,  but  which  did 
involve  either  design  and  development  or  systems  Integration. 

Generally,  the  contracts  of  interest  were  those  let  in  Phase  II  of  the 
DoD  Acquisition  Cycle:  Engineering  and  Manufacturing  Development  (EMD) . 


The  sample  was  selected  from  available  contracts  at  WPAFB.  While 
this  decision  limited  the  research  to  a  sub-set  of  USAF  contracts  only, 
this  was  believed  to  be  representative  of  DoD  acquisition-contracting 
practice  for  two  reasons:  firstly,  all  Services  are  mandated  to  vise  the 
same  acquisition  procedures;  and  secondly,  WPAFB  has  been  a  major 
acquisition  center  within  the  USAF. 

To  address  the  investigative  questions,  a  review  of  the  literature 
relevant  to  this  research  was  conducted.  There  is  a  significant  body  of 
knowledge  concerning  the  ma^gement  of  projects  within  am  orgamization; 
however,  there  has  been  little  research  into  the  management  of  schedule 
via  the  contractual  process.  The  literature  did  provide  some  insight 
into  which  project  characteristics  were  relevant  to  schedule 
perf ormauice ;  however,  little  else  was  gleamed. 

Three  studies  conducted  by  the  RAND  corporation  in  1971,  1980,  amd 
1990  investigated  several  different  aspects  of  the  DoD  acquisition 
process.  The  1971  study  found  that,  for  the  24  systems  investigated, 
the  average  schedule  overrvm  was  15%.  The  1990  study  found  that,  for 
the  ten  systems  investigated,  the  average  schedule  overrun  was  33%.  The 
studies  conducted  by  the  RAND  corporation  and  this  research  effort  are 
distinctly  different.  Firstly,  the  RAND  studies  focused  on  the  overall 
acquisition  process  with  respect  to  program  schedule  for  major  programs. 
This  research,  on  the  other  hand,  focuses  on  the  contracted  schedule 
performance  for  small-scale  programs.  Secondly,  the  RAND  studies 
investigated  schedule  performance  from  the  perspective  of  external 
factors  and  program  characteristics,  whereas  this  research  investigates 
schedule  performance  from  the  perspective  of  the  influence  of  management 
actions.  Finally,  the  results  from  the  RAND  studies  were  qualitative  in 


nature,  whereas  the  results  from  this  research  have  been  supported  by 
rigorous  statistical  analyses.  This  overview  of  the  differences  between 
^  these  three  studies  and  the  cnirrent  research  demonstrates  the  timeliness 

and  the  importance  of  this  research  effort.  The  relationship  between 
«  pre-contract -award  management  actions  and  the  resultant  schedule 

performance  has  not  previously  been  investigated. 

To  identify  the  management  actions  that  may  have  the  potential  to 
impact  schedule  performance,  a  review  of  the  applicable  policy 
directives,  Ixistructlons,  and  manuals  %fas  undertaken.  From  this  review, 
a  candidate  variable  list  tfas  generated,  a  copy  of  which  is  attached  at 
Appendix  B.  This  list  was  further  refined  to  produce  the  Data 
Collection  Instrument  (DCI) ,  a  copy  of  which  is  presented  in  Figure  3-2. 

The  contract -management  database,  the  Acquisition  Management 
Information  System  (AMIS),  was  used,  in  conjunction  with  SPO  personnel, 
to  obtain  the  requisite  sample.  Measures  of  the  independent  variables 
of  interest  were  obtained  directly  from  the  contract  files,  and  were 
recorded  on  the  DCI.  Measures  of  the  dependent  variaUsle  --  schedule 
performance  --  were  obtained  from  a  nximber  of  different  sources, 
specifically  the  AMIS  database,  the  Mechanization  of  Contract 
Administration  Services  (MOCAS)  database,  the  Buyer,  or  the  PM.  when  a 
sufficiently  representative  san^le  had  been  obtained,  statistical 
methods  were  utilized  to  analyze  the  data.  This  is  the  subject  of  the 
.  next  section. 
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Data  for  29  contracts  «fere  obtained,  though  schedule  performance 
was  only  able  to  be  assessed  for  25  of  them.  For  those  25  contracts, 
the  average  schedule  performance  was  found  to  be  70.77%,  with  a  range 
from  -27.9%  to  334.0%.  This  average  measure  was  significantly  higher  ^ 

than  that  found  in  the  tvro  previous  RAND  studies;  hoiraver,  the 
distribution  of  schedule  performance  was  quite  skewed,  as  evidenced  by 
the  median  which  was  only  39.4%.  When  the  two  outliers  were  removed, 
the  average  schedxile  performance  decreased  to  50.97%,  which  is  still 
considerably  higher  than  in  the  two  previous  studies. 

From  the  analyses  that  were  conducted,  a  number  of  factors  were 
found  to  be  significantly  related  to  schedule  performance.  Furthermore, 
these  factors  were  interpretable  in  a  management  context.  Specifically, 
the  number  of  contract  modifications  was  shown  to  be  the  most 
significant  contributing  factor  to  schedule  performance.  The  point 
estimate  for  the  deterioration  in  schedule  performance  was  found  to  be 
1.59  percentage  units  per  contract  modification.  The  number  of  contract 
modifications  was  measured  as  a  surrogate  variable  to  encapsulate  the 
effects  of  all  the  post-contract-award  factors  on  schedule  performance. 

The  specific  management  factors  which  were  identified  as  having  a 
significemt  influence  on  schedule  performance  were: 

a.  whether  or  not  the  contract  was  pre-scheduled  (i.e.,  was  the 

contracted  schedule  performance  dictated  to  the  contractor) ;  *■ 

b.  whether  or  not  the  contract  involved  concurrency; 

c.  whether  or  not  a  preliminary  WBS  had  been  developed; 
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d.  whether  or  not  the  contract  utilized  a  Functional 
Specification  or  a  Prime  Item  Development  Specification 
(PZDS)  (i.e.,  a  Type  A  or  a  Type  B  specification); 

e.  whether  or  not  the  contract  required  the  schedule 
information  to  be  presented  in  a  nettfork  format;  and 

f.  the  ntunber  of  DZOs  that  irare  required  by  the  CDRL. 

Each  of  these  factors  can  be  directly  influenced  by  the  Program  Manager; 
hence,  placing  emphasis  on  these  actions  may  reap  considereOale  benefit. 

The  pre- scheduling  of  a  contract  by  the  DoD  was  found  to  have  a 
beneficial  effect  on  schedule  performance.  The  point  estimate  for  the 
in^rovement  in  schedule  performance  that  resulted  from  the 
iiiq>lementation  of  this  management  action  was  found  to  be  47  percentage 
vtnits.  Concurrency,  on  the  other  hand,  was  foxuid  to  have  a  detrimental 
effect  on  schedule  performance,  with  a  point  estimate  for  the 
deterioration  of  schedule  performance  of  23  percentage  units.  The 
development  of  a  MBS  was  found  to  have  a  beneficial  effect  on  schedule 
performance;  however,  the  magnitude  of  the  effect  was  unable  to  be 
determined.  The  use  of  a  Type  A  specification  was  found  to  be 
beneficial  with  respect  to  schedule  performance,  in  comparison  with  the 
use  of  a  Type  B  specification.  The  point  estimate  for  the  lnq>rovement 
in  schedule  performance  associated  with  the  use  of  a  Type  A 
specification  was  found  to  be  20  percentage  units.  The  presentation  of 
schedule-nunagement  Information  in  a  network  format  was  found  to  promote 
better  schedule  performance,  in  ccmqparison  with  a  lower-level 
presentation  (e.g.,  Oantt  charts).  The  point  estimate  for  the 
improvement  in  schedule  performance  associated  with  the  use  of  a  network 
format  was  found  to  be  37  percentage  units.  Finally,  the  number  of  DIDs 


required  by  the  CDRL  was  found  to  have  a  detrimental  effect  on  schedule 
performance,  in  that,  as  the  number  of  DZDs  increased,  the  schedule 
performance  worsened  by  0.4  percentage  units  per  DID. 

From  the  analyses  that  were  conducted,  a  large  number  of  factors 
mre  not  found  to  be  significantly  related  to  schedule  performance.  Th 
intuitively  significant  variables  that  were  not  found  to  be  related  to 
schedule  performance  included: 

a.  the  contract  type, 

b.  the  aggressiveness  of  the  schedule, 

c.  the  assessment  of  technical  risk, 

d.  the  development  of  the  WBS  (SOW  requirement) , 

e.  the  requirement  for  C/SSR, 

f.  the  frequency  of  reporting  schedule -management  information, 

g.  the  number  of  project -management  DIDs, 

h.  the  number  of  evaluation  criteria  related  to  schedule 
management ,  euid 

i.  the  evaluation  of  schedule-management  information  during 
source  selection. 

The  small  sanq)le  size  precluded  a  con^lete  assessment  of  these  factors 
that,  a  priori,  were  believed  to  influence  schedule  perf ormauice . 

Further  research  is  required  to  more  thoroughly  assess  these  factors. 

It  is  inq>ortant  to  note  at  this  stage,  however,  that  these  factors  were 
not  found  to  be  significant  within  the  limitations  of  this  thesis. 


The  findings  associated  with  this  research  effort  are  believed  to 


be  very  significamt,  especially  with  respect  to  the  inqplications  for 
schedule  management.  This  section  will  discuss  the  significance  of 
these  findings,  including  the  limitations  of  the  results,  and  the 
implications  for  schedule  management  and  for  futiire  research  in  this 
area. 

Implications  for  Small-scale  Programs 

This  study  foimd  that  the  average  schedule  overrun  for  small- 
scale,  design  emd  development  contracts  at  HPAFB  was  70.77%.  while  this 
result  is  not  conclusive  (due  to  san^le-size  limitations) ,  this  finding 
is  considerably  at  odds  with  previous  research  (even  when  the  outliers 
are  removed  from  the  sample) .  Given  that  all  previous  studies  have 
examined  major  programs,  the  implication  of  this  research  is  that 
schedule  performance  for  small-scale  programs  is  consideredsly  poorer 
thaui  for  large-scale  programs.  Furthermore,  given  that  the  sample  was 
considered  to  be  representative  of  DoD  contracting  practices,  a  second 
implication  of  this  result  is  that  the  poor  schedule  perfonmance  for 
small-scale  programs  is  widespread.  Finally,  a  third  implication  of 
this  result  is  that  the  factors  that  affect  schedule  perfonmance  in 
small-scale  programs  are  either  not  well  understood,  or  the  current  DoD 
directives  and  instructions  (i.e.,  the  DoD  5000  series),  which  are 
tailored  to  large-scale  programs,  are  not  applicable  to  small-scale 
programs.  Further  research  is  required  to  assess  whether  or  not  this 
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last  point  is  valid;  research  that  could  have  significant  implications 
for  the  management  of  schedule  in  small-scale  programs. 

• 

Implications  for  Schedule  Management 

From  the  analyses  that  were  conducted,  the  number  of  contract 

a 

modifications  was  found  to  be  the  roost  significant  contributing  factor 
to  schedule  performance.  This  result  is  in  accord  with  the  currently 
held  belief  that  post -contract -award  factors  are  the  major  driver  of 
schedule  performance.  The  inplication  of  this  research,  therefore,  is 
that  further  research  needs  to  be  conducted  to  determine  which  pre¬ 
contract-award  actions  have  an  influence  on  the  number  of  contract 
modifications . 

A  number  of  pre-contract-a%irard  management  actions  were  found  to 
positively  influence  schedule  performance.  The  inplication  of  these 
results  to  Program  Managers  is  that  these  'known'  factors  can  now  be 
explicitly  incorporated  into  the  acquisition  strategy,  auid  the  resulting 
contractual  documentation.  Potentially,  the  recognition  of  these 
factors  as  known  contributors  to  schedule  perfomuuice  could  have 
significant  benefits  for  the  management  of  schedule. 

To  adequately  inplement  the  factors  which  have  been  demonstrated 
to  be  significantly  related  to  schedule  performance,  the  limitations  of 
the  analysis  need  to  be  addressed.  A  difficulty  in  applying  these 
results  is  that  many  of  the  factors  were  measured  on  a  coarse  scale; 
that  is,  the  factor  was  identified  as  either  being  present  or  not  being 
present.  To  clarify  this  point,  the  situation  with  respect  to 
concurrency  will  be  discussed  in  greater  depth.  When  the  existence  of  ^ 

concurrency  was  observed  in  a  contract,  the  degree  of  that  concurrency 
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was  not  investigated.  The  applicability  of  this  result,  therefore,  is 
somewhat  limited.  Furthermore,  due  to  the  way  that  schedule  performance 
was  measured,  there  was  no  ability,  based  on  the  results  of  this 
research,  to  ascertain  whether  the  worse  schedule  performance  that 
resulted  from  the  use  of  concurrency,  was  negated  by  the  concurrency 
itself.  These  comments  do  not  detract  from  the  findings;  rather,  they 
point  out  that  the  results  obtained  should  be  treated  with  caution. 
Furthermore,  these  comments  highlight  the  need  for  further  research  to 
obtain  a  fuller  appreciation  of  the  relationships  between  the  identified 
management  actions  and  the  resultant  schedule  performance. 

Management  of  Schedule  within  the  SPOs 

As  a  general  comment,  the  management  of  schedule  is  not  well 
understood  within  the  SPOs.  This  comment  is  supported  by  the  following 
observations  that  were  noted  during  the  data-collection  process: 

a.  Different  schedule-management  information  was  required  for 
the  source-selection  evaluation  than  was  required  to  manage 
the  contract  (e.g.,  a  Geuitt  chart  was  requested  for  the 
source -selection  evaluation,  whereas  a  network  diagram  was 
required  for  the  management  of  the  contract  (and  vice- 
versa)  )  . 

b.  A  considercUsle  amount  of  schedule -nuuiagement  information  was 
found  to  be  'buried'  within  a  wide  array  of  DZDs  (e.g., 
resource  constraints  were  required  to  be  evaluated  in  many 
planning  DIDs) .  In  many  situations,  the  equivalent 
information  was  not  required  to  be  delivered  with  the 
source- selection  documentation.  The  groxmdwork,  therefore. 


to  enable  effective  £uid  proactive  management  of  schedule,  as 
required  by  the  DIDs,  vras  not  being  established. 

In  the  majority  of  contracts  examined  during  the  data- 
collection  process,  the  schedule-management  requirements 
were  rarely  specified  in  a  coherent  and  integrated  manner 
(e.g.,  schedule -presentation  information  was  separated  from 
the  evaluation  of  resource  constraints  and  from  the 
allocation  of  responsibility) .  Many  modem  software 
pac)cages  allow  for  the  explicit  consideration  of  resource 
constraints  as  a  part  of  the  development  of  the  program 
schedule;  hence,  an  integrated  approach  to  schedule 
development  would  enable  the  8d>ilities  of  these  software 
packages  to  be  more  fully  exploited. 

In  the  majority  of  RFPs  examined  during  the  data-collection 
process,  the  WBS  (perhaps  the  major  schedule-planning 
document)  was  found  'hidden'  in  the  cost -requirements 
section  of  the  ITO.  The  inplication  of  this  finding  is  that 
the  WBS  is  seen  by  the  SPO  to  be  a  more  effective  tool  for 
managing  cost  than  it  is  for  managing  schedule. 

In  many  contracts  examined  dviring  the  data-collection 
process,  the  SOW  required  that  the  WBS  be  periodically 
updated  throughout  the  life  of  the  contract  without  tying 
the  requirement  for  a  WBS  to  any  other  requirement  in  the 
contract.  Furthermore,  a  number  of  RFPs  which  required  that 
the  offeror  update  the  preliminary  WBS  with  his/her  proposal 
did  not  require  that  the  WBS  be  used  for  contract -management 
purposes.  Moreover,  a  nixnber  of  RFPs  which  did  not  include 


a  preliminary  WBS  required  that  the  resultemt  contractor 
utilize  a  WBS  for  contract -management  purposes. 

£.  None  of  the  contracts  in  the  san^le  atten^ted  to  integrate 
C/SSR  or  C/SCSC  with  network  information.  Furthermore,  the 
guidance  concerning  the  use  of  C/SCSC,  in  comparison  with 
C/SSR,  appeared  to  be  inappropriately  applied  at  times 
(i.e.,  C/SCSC  was  specified  for  some  contracts  with  a  face 
value  (or  potential  worth)  significantly  below  the  mandated 
threshold) . 

g.  Almost  none  of  the  contracts  in  the  sample  were  assessed  as 
having  a  schedule  risk  of  higher  tluui  medium,  yet  23  of  the 

e 

25  contracts  in  the  sample  were  not  con^leted  within  the 
requisite  time  period. 

h.  Schedule -management  requirements,  as  stated  in  the  SOW  euid 
CDRL,  were  rarely  proactive. 

i.  Only  a  limited  number  of  techniques  were  specified  in  the 
SOW  and  the  ITO  for  the  nuuiagement  of  schedule  (e.g.,  the 
use  of  PERT,  simulation  studies,  euid  contingency  schedules 
were  rarely,  if  ever,  seen) . 

j.  From  a  subjective  evaluation  of  the  contracts  examined,  the 
schedule -management  requirements  in  many  of  the  contracts 
appeared  to  be  constructed  via  the  'copied- from'  principle 
within  each  SFO.  That  practice  led  to  the  inclusion  of 
inappropriate  schedule-management  techniques  in  some 
contracts . 

These  observations  highlight  that  the  range  and  use  of  schedule- 
management  techniques  are  not  well  understood  within  the  SPOs.  This 
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lack  of  understanding  implies  that  realistic  and  effective  schedule- 


management  requirements  will  rarely  be  included  in  contractual 
docximentation.  Furthermore,  the  ability  to  exploit  the  available 
technologies  for  the  management  of  schedule  will  be  limited.  To 
overcome  these  observed  shortfalls,  a  training  program  could  be 
instigated  which  addresses  the  requisite  schedule-management  procedures, 
or  a  set  of  guidance  instructions  could  be  generated  which  assists  in 
the  specification  of  schedule-management  requirements.  On  a  positive 
note,  however,  some  of  these  difficulties  may  be  overcome  with  the 
introduction  of  the  revised  schedule-risk-assessment  procedures 
currently  being  Introduced  in  ASC  (as  discussed  in  Chapter  ZI) . 

Data  Collection 

The  difficulties  associated  with  obtaining  the  data  for  this 
research  highlight  that,  unless  steps  are  taken  in  the  near  future  to 
start  collecting  the  relevant  data,  the  ability  to  assess  the  efficiency 
euid  effectiveness  of  contract -mcuiagement  actions  will  continue  to  be 
virtually  non-existent.  This  data -col lection  effort  is  not  a  small 
task;  however,  the  relatively  small  efforts  that  would  be  required  up 
front  would,  in  all  probability,  reap  considerable  benefits  in  the 
longer  term.  (Note  that,  the  relatively  new  project -management 
database,  the  Contract  Mamagement  Network  (CMN)  (refer  Chapter  III) ,  may 
partially  meet  the  needs  of  this  data-collection  requirement . ) 

As  a  corollary  to  the  preceding  conment,  better  house-keeping  of 
contractual  documents  amd  the  existing  contract  management  datadsases  -- 
AMIS  amd  MOCAS  --  is  required.  The  fact  that  a  nvimber  of  the  major 
contract\ial  documents  were  missing  from  a  significamt  nvimber  of  files  is 
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difficult  to  understand.  Furthermore,  the  current  problems  with  the 


schedule  information  which  is  input  into  AMIS  (in  particular)  should  be 
resolved  in  the  near  future  to  en2d>le  this  vehicle  to  be  effectively 
utilized  for  schedule  management  and  for  future  schedule-performance 
analyses . 


Possible  Follow-on  Research 

Validation  of  the  Research  Findings 

The  investigation  of  the  relationships  between  mamagement  actions 
and  schedule  performance  has  not  been  undertaken  previously. 

Furthermore,  this  research  effort  addressed  a  broad  ramge  of  DoD 
contract -management  practices.  Considerable  effort  was  required, 
therefore,  to  ascertain  which  variables  should  be  included  in  the 
analyses..  As  a  result  of  this,  only  a  small  group  of  individuals  were 
involved  in  validating  the  DCI.  Follow-on  research,  therefore,  could 
focus  on  a  number  of  aspects  related  to  validation  of  the  research 
findings.  These  aspects  are  addressed  in  the  following  paragraphs. 

DCI  Validation.  As  only  a  small  number  of  individuals  were 
Involved  in  validating  the  DCI,  there  is  no  clear  indication  that  all  of 
the  relevant  variables  have  been  considered.  A  thorough  're -scrubbing' 
of  the  relevant  DoD  instructions,  directives,  auid  manuals  (including  the 
FAR)  could  be  used  to  validate  the  varieQjle  list,  euid  to  generate  other 
potential  factors.  Another  approach  could  be  to  survey  SPO  personnel  to 
obtain  a  wider  perspective  of  the  relevant  factors. 

Variable  Evaluation  Measures.  Are  there  better  measures  for 
evaluating  the  relevant  factors  than  the  ones  used  in  the  DCI?  For 


•xaiif>le,  difficulties  were  experienced  obtaining  adequate  measures  for 
assessing  planning  performance.  Once  again,  a  survey  of  SPO  personnel 
could  be  vised  to  obtain  better  measvires  for  this  aspect. 

Narrower  Focus.  Future  thesis  efforts  could  focus  in  more  depth 
on  one  of  the  fovu:  activity  areas  associated  with  the  contractual 
process  (i.e.,  planning,  specifying,  evalviating,  and  monitoring  and 
controlling)  to  examine  the  relationship  between  the  actions  in  those 
activity  areas  and  contractual  objectives  (i.e.,  cost,  schedule,  or 
performance) . 

Expansion  of  the  Model.  The  research  conducted  under  this  thesis 
effort  did  not  evaluate  any  variables  related  to  actual  source 
selection.  The  model  developed  here  could  be  expanded  to  include  the 
variables  associated  with  the  source-selection  evaluation  process 
(though  this  would  require  access  to  source- selection  sensitive 
information) . 

Model  Va^^<^a^^on/BxDansion.  To  validate  the  model  constructed 
from  the  statistical  analyses,  a  new  data-set  could  be  obtained.  These 
additional  data-points  could  be  either  added  to  the  model  or  predictions 
from  the  model  could  be  obtained  ^uld  conqpared  to  actual  contract 
outcomes.  Furthermore,  data  for  contracts  outside  the  scope  of  the 
research  (e.g.,  C/SCSC  contracts)  could  be  obtained  to  broaden  the 
applicad)ility  of  the  model. 

Related  Research 

The  preceding  research  ideas  have  focused  on  the  model  obtained 
through  this  thesis  effort.  A  nvunber  of  other  potential  research  topics 


present  themselves  as  an  outcome  of  this  research.  These  are  explained 
in  the  following  paragraphs. 

Pre - contract - award  Aet: l nna .  This  research  identified  a  number  of 
pre-contract-award  maxuigement  actions  that  %#ere  found  to  be  related  to 
schedule  performance  for  small-scale  programs.  Many  of  these  numagement 
actions  were  meastired  on  a  coarse  scale;  that  is,  the  factor  was 
identified  as  either  being  present  or  not  being  present.  More  in-depth 
analysis  is  required  to  gain  a  fuller  appreciation  of  the  underlying 
factors  associated  with  the  relationship  between  the  identified 
management  actions  and  schedule  performance. 

Post-contract-avraird  Actions.  Given  that  the  number  of  contract 
modifications  was  found  to  be  the  main  variad>le  which  contributed  to 
schedule  perf ormauice ,  a  line  of  research  could  be  followed  which 
parallels  the  efforts  undertaken  through  this  research  effort.  For 
exaiiq>le,  an  investigation  could  be  made  into  which  pre -contract -award 
numagement  actions  are  drivers  of  post -contract -award  changes. 

Source- selection  Variables.  The  variables  analyzed  under  this 
research  effort  were  limited  to  those  which  were  not  source- selection 
sensitive.  An  interesting  research  proposal  could  be  to  analyze  whether 
a  relationship  exists  between  the  information  provided  to  the  offerors 
in  Section  L  (Instructions  to  Offerors  (ITO) )  2uid  Section  M  (Evaluation 
Factors  for  Award)  of  the  RFP  and  the  actions  that  are  imdertaken  during 
the  source- selection  process.  This  could  be  used  to  ascertain  whether 
or  not  the  current  procedures  for  specifying  Section  L  and  Section  M  of 
the  RFP  are  adequate  and  effective. 

Data  Collection  Related  to  Project  Outcomes.  Two  of  the  major 
difficulties  associated  with  this  :'esearch  were  determining  which 


variables  to  measvixe  and  where  to  obtain  the  requisite  data.  If  the  DoD 


tfere  serious  about  liiq>rovlng  the  acquisition  process,  then  the 

effectiveness  of  the  mandated  procedures  and  associated  management  « 

actions  should  be  assessed.  To  enable  the  necessary  analyses  to  be 
performed,  significant  quantities  of  data  need  to  be  stored  and  ^ 

analyzed.  As  stated  by  Merrow  and  Yarossl,  ” [ — ]  little  progress  can 
be  expected  In  the  state  of  o\ir  knowledge  of  projects  without  systematic 
and  detailed  data  collection"  (Merrow  and  Yarossl,  1990:H.6.3) .  A 
research  project  could  analyze  which  data  would  be  required  to  determine 
which  variables  affect  project  outcomes.  This  %rould  be  a  major  research 
undertaking,  but  the  end  result  would  be  of  considerable  inqport. 

Chanter  Summary 

This  chapter  has  summarized  the  first  four  chapters  of  the  thesis. 

An  overview  of  the  requirement  for  this  research,  the  scope  of  the 
research,  emd  the  Investigative  questions  associated  with  this  research 
were  presented.  Following  this,  a  brief  discussion  of  the  findings, 
relevant  to  the  investigative  questions,  was  presented.  The 
significance  of  the  findings  was  also  discussed,  especially  with  respect 
to  the  implications  for  schedule  management.  Finally,  a  number  of 
potential  areas  for  follow-on  research  were  presented. 

The  findings  from  this  research  effort  have  considerable  Import 
for  schedule  management.  Firstly,  a  number  of  factors  were  identified  *■ 

which  were  significantly  related  to  schedule  performance.  The 
incorporation  of  these  known  factors  into  the  relevamt  contractual  ^ 

docxunentation  could  have  significant  benefits  for  schedule  mauiagement. 
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Secondly,  a  niimber  of  observatione  concerning  the  specification  of 
schedule-management  requirements  highlighted  that  the  management  of 
schedule  did  not  appear  to  be  «rell  understood  within  the  SPOs.  Training 
programs  on  this  subject,  therefore,  could  be  of  considerable  benefit. 
Finally,  the  problems  associated  with  the  contract  files  and  the 
contract -management  databases  were  highlighted,  in  the  hope  that  future 
research  teams  could  benefit  from  the  lessons  learned  through  this 
research  effort. 


» 


% 
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ABCaadito  A; _ Liat  of  Acronvina 


4 


a 


ACO 

AERP 

APFARS 

APIT 

APR 

AMIS 

AMSOL 

AMOVA 

AP 

ASC 

ASREQ 

ATS 

CALS 

CCP 

CDRL 

CDR 

CGUDS 

CZDS 

CLIN 

CMN 

CPAP 

CPPF 

CPIP 

CPM 

C/SCSC 

C/SSR 

CPR 

DCI 

DEARS 

DIO 

DoD 

ECP 

BMD 

FAR 

FCA 

PEP 

PPIP 

FPIS 

OERT 

ITO 

JIO 

MOCAS 

PDM 

PDR 

PERT 

PIDS 

PM 

PMBOR 

PMI 


Adiiilniatration  Contract  Officer 
Aircrew  Eye/Reaplratory  Protection 
Air  Force  EAR  Supplement 
Air  Force  Inatitute  of  Technology 
Air  Force  Regulation 

Acquiaitlon  Management  Information  Syatem 

Acquialtion  Management  Syatem  and  Data  Reguirementa  Control 
Liat 

Analyala  of  Variance 
Acquialtion  Plan 
Aeronautical  Syatem  Center 
Aa  Required  Herein 
Aircrew  Training  Syatem 
Contingency  Airfield  Lighting  Syatem 
Contract  Change  Propoaal 
Contract  Data  Requirementa  Liat 
Critical  Dealgn  Review 

Cooputer  Generated  Acquialtion  Documents  System 

Critical  Item  Development  Specification 

Contract  Line  Item  Number 

Contract  Management  Net%#ork 

Coat  -  Plus  >  Avfard-  Fee 

Cost-Plus - Fixed- Fee 

Cost  -  Plus  -  Incentive-  Fee 

Critical  Path  Method 

Cost/Schedule  Control  Systems  Criteria 

Cost/Schedule  Status  Report 

Cost  Performance  Report 

Data  Collection  Instrument 

DoD  FAR  Supplement 

Data  Item  Description 

Department  of  Defense 

Engineering  Change  Proposal 

Engineerixig  and  Manufactiiring  Development 

Federal  Acquisition  Regulations 

Functional  Configuration  Audit 

Firm  Fixed- Price 

Fixed-Price-Incentive  Firm  Target 
Fixed- Price -Incentive  Successive  Targets 
Graphical  Evaluation  and  Review  Technique 
Instructions  to  Offerors 
Joint  Inqplementation  Guide 

Mechanization  of  Contract  Administration  Services 

Precedence  Diagram  Method 

Preliminary  Design  Review 

Program  Evaluation  ud  Review  Technique 

Prime  Item  Development  Specification 

Program  Manager 

Project  Management  Body  of  Knowledge 
Project  Management  Institute 


A-l 


RDT&B 

RFP 

SBMP 

SLR 

SON 

SP 

SPO 

SSBT 

SSO 

USAF 

VIF 

NBS 

NP 

NPAFB 


Research,  Develoimient,  Test,  and  Bvaliiation 

Request  for  Proposal 

System  Engineering  Management  Plan 

Simple  Linear  Regression 

Statement  of  Work 

Schedule  Performance 

System  Program  Office 

Source  Selection  Evaluation  Teeun 

Source  Selection  Office 

Ohlted  States  Air  Force 

Variance  Inflation  Factor 

Work  Breakdown  Structure 

Work  Package 

Nrlght- Patterson  Air  Force  Base 


Hay  be  able  to  "factor  up"  the  acquisition  strategy  variables  with 
the  PR  package  variables  to  give  the  answer  to  tvo  questions,  virtiich  then 
become  the  variables  of  interest  to  the  model: 

(1)  How  well  is  the  acquisition  strategy  transferred  into  the  PR 
package,  score  on  a  1  -  10  scale. 

(2)  How  effective  are  the  planning  aspects  (by  a  measure  such  as 
the  sum  of  the  lower  level  measures  divided  by  the  total  max 
score  possible?) ,  score  on  a  scale  of  1  -  10 . 


a.  Streamlining  Variable 


Questions  to  Answer/Measures 

Wbere  to  Find 

Type 

Question  and  answer  checklist: 

In  the 

0/1 

acquisition 

then 

Is  the  schedule  considered  aggressive?  0/1 

plan. 

ORD 

Is  concurrency  considered  --  early,  middle, 
late?  1-3 

Were  phases  combined/eliminated?  0/1 

Were  design  reviews /audits 
combined/eliminated?  0/1 

Was  pre- scheduling  performed?  0/1 

Was  it  used  in  the  RFP  and  source  selection 
criteria?  0/1 

Was  contingency  planning  allowed  for?  0/1 
Result  --  total  up  the  0/1  scores, 
b.  Source  of  SupdIv  Variable 

Questiona  to  Anawar/Maaauraa  Where  to  Find  Type 

#  firms  on  source  selection  list.  Acquisition  INT 

plan. 

#  responses  to  interest  statement.  Interest 

statement . 
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#  RFPs  nailed. 


Evaluation 
report . 


#  offers  received. 

(How  to  factor- in  conpetitive/non- 
cooqpetitive?) 

Utilize  some  type  of  metric  combining  these, 
some  divided  by  others. 


c.  ggntrigt  Tym 


Queationa  to  Anaver/Meaaurea 

Mhers  to  Find 

Type 

Arranged  in  the  appropriate  order,  then 
scored  on  a  1-4  scale: 

FPP,  FPIP,  CPIP,  CPPP 

RPP 

Acq.  Plan 

ORD 

1-4 

Need  to  work-in  the  schedule  incentive  vs 
fixed- fee  type  of  trade-offs  in  this  measure. 

Contract 

RjgK 

a.  gghsiamfl  RisK  vfltglafrlg 

Queationa  to  Anawer/Meeaurea 

Where  to  Find 

Type 

Here  risks  Identified  in  the  schedule,  i.e., 
were  there  major  risks  seen  in  the  program? 

0/1 

Acq.  plan 

RPP 

0/1 

then 

ORD 

l-> 

Here  the  risks  analyzed  and  assessed  for 
their  possible  effect  on  con^letion  time  of 

Source  - 
Selection 

the  project?  0/1 

Here  the  risks  then  managed  appropriately 
i.e.,  did  the  RFP  and/or  source  selection 
take  the  identified  risk  into  accoimt,  or  was 
it  disregarded?  O/l 

Result  —  combine  into  one  variable  by  the 
scoresheet  approach. 

Systems  Engineering 

a.  Complexity  Variable 

Questioas  to  Answer/Measures 

Need  to  get  a  metric  of  this,  perhaps  with  an 
individual  measure  or  combinations  of: 


Where  to  Find  Type 

Acq.  plaui  INT 


#  activities/#  precedence  relationships 
total  $/total  end  item  qvuuitity 

#  pages  in  spec . ,  SOW 

#  referenced  documents 

#  referenced  texts 

#  engineering  disciplines  required 

#  hardware  items 
%  R&D  dollars 

%  design  or  design  development  dollars 


Work  Breakdown  Structure 


Type 

0/1 

ORD 


What  level  of  WBS  was  initially  provided  for  Contract, 
the  respondents  to  work  with?  0->3 

Contract 

#  elements  at  level  (lowest,  or  3)?  0->  reports. 

Thoroughness  measure  --  how  well  was  the  up¬ 
front  WBS  breakdown  done  i . e . ,  con^are  up¬ 
front  to  finalized  WBS.  0->10 

#  elements/scope,  where  scope  «  dollars  or 
direct  labor  hours  or  similar. 

Result  --  roll  all  this  into  one  value  by  the 
score  sheet  approach. 


a.  WBS  Variable 

Questions  to  Answer/Measures  Where  to  Find 

Was  WBS  specified?  0/1  Acq  plan. 

Was  WBS  mandated?  0/1  SOW 


Contract 

schedule 

SOW 

Cost  reports 


Specifying  the  Requirement 


specification 


a.  Specification  Definition  Variable 


Questions  to  Aaswer/Measures 

Where  to  Find 

Type 

#  pages  in  the  spec 

SOW/ Spec 

INT 

#  individual  specs 

Acq .  Plsm 

ORD 

#  reference  documents 

How  well  specified,  i.e.,  functional  only  or 
detailed  (how  do  we  quauitify  this  aspect?) . 

Possibly  this  is  a  complexity  meastire  too. 


Statement  Of  Work 

a.  SOW  Completeness  Variable 

Questions  to  Aaswer/Measures  Where  to  Find  Type 

Checklist:  Does  the  SOW  task  the  contractor  SOW  ORO 

to : 

-  define,  monitor  and  report  on  project- 
mauiagement  responsibilities 

-  perform  project  planning 

-  increase  the  WBS  to  lower  levels 

-  CSSR 

-  integration  of  CSSR  and  schedule  network? 

-  if  not  CSSR,  then  smother  technique? 

-  schedule  varismce  thresholds  --  considered 
for  both  the  CP  smd  near  CP  over  the  whole 
project?  0/1 

-  Is  the  monitoring  suid  control  Information 
integrated  with  the  network?  0/1 

-  show  a  schedule  smd  to  actively  manage 
to/report  on  that  schedvile 


B-4 


-  frequency  of  reporting? 


-  show  a  systems  engineering  management  plan 

-  show  test  and  evaluation  planning 

-  show  technical  review  and  audit  plan 

-  show  ILS  plaui 


CDRL  and  DIP 

a.  gPRfc 

Questions  to  Answer/Measures  Khere  to  Find  Type 

Is  scheduling  information  required  --  CP,  SOW  ORD 

near  CP,  probability?  0/1  (Does  this  relate 

to  some  of  the  other  measures  we  got  before?)  Contract 

To  what  level  is  the  scheduling  information 
required?  1-4 

How  often  is  the  scheduling  information 
required?  1-4 

b.  DID  Varaible 

Questions  to  Answer/Measures  Where  to  Find  Type 

Is  a  schedule  risk  assessment  required?  0/1 

?  ? 

Are  DID  requirements  too  specific,  or  not 
specific  enough?  (How  to  measure?) 


Purchase  Request  Package 
a.  PR  Package  Variable 

Questions  to  Answer/Measures  Where  to  Find  Type 

Contract  type,  same  as  in  the  Acquisition 
Strategy  variable  on  l->4  scale. 

Was  schedule  a  stated  evaluation  criteria 
(this  is  in  the  risk  management  area  too?) 

0/1 

Was  the  method  of  evaluation  stated?  (risk) 

0/1 


PR  Package  ORD 

Source  - 
Selection 


How  thorough  an  evaluation?  (risk) 

RFP  data  list  --  detailed  "one  to  one" 
response  against  the  SOW?  0/1 


Evaluating  the  Proposal 


a.  Schedule  Variable 

Questions  to  Answer/Measures  Mhsre  to  Find  Type 

Here  contractors  told  that  schedule  vrould  be  Source  -  0/1 

an  evaluation  criteria?  0/1  Selection. 

Here  the  evaluation  criteria  specific  enough  RFP  package, 
to  enable  the  contractor  to  know  how 
in^rtant  the  schedule  was  considered  to  be? 

0/1 

How  was  the  schedule  evaluated  -- 
thoroughness,  activity  times  etc.?  (scale  1- 
>) 

Has  there  a  data  list  in  the  RFP  that 
outlined  the  RFP  data  requirements,  and  was 
it  realistic  vs  the  actual  CDRL?  0/1 


b.  HBS  Variable 
Questions  to  Answer/Measures 
How  well  was  it  done?  l-> 
Thoroughness  measvire?  l-> 

Activity  Time  Variable 

Here  activity  times  estimated?  0/1 


Where  to  Find  Type 

Contractor  ORD 

response 


Contractors  0/1 

response 


c.  Activity  Responsibility  Allocation  Variable 

Questions  to  Answer/Measures  Where  to  Find  Type 

Has  an  activity  responsibility  allocation  Contractors  0/1 

done?  0/1  response 


Was  the  allocation  appropriate?  0/1 


B-6 


d. 


Resource  Allocation  Variable 


♦ 


Questions  to  Aaawer/Meaaurea 
Requested  within  the  project?  0/1 
Requested  between  projects?  0/1 
Are  there  contingency  resources?  0/1 


Hhere  to  Find  Type 

SOW  0/1 

Contractors 

response 


e.  Risk  Assessment  Variable 

Questions  to  Anaver/Meaaurea  Where  to  Find  Type 

Were  the  CP  and  near  CP  identified?  0/1  SOW  0/1 

Contractors 

Was  a  probabilistic  approach  used  to  evaluate  response 
schedule  time?  O/l 


£.  Concurrent  Engineering  Variable 

Questions  to  Answer/Measures  Where  to  Find  Type 

Is  the  contractor  doing  concurrent  Contractors  O/l 

engineering?  0/1  response 
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Appendix  C;  Contract  List 


P33657-76-C-0103 

F33657-76-C-0792 

P33657-81-C-2041 

P33657-81-C-2107 

P33657-83-C-2141 

P33657-83-C-2217 

P33657-84-C-0117 

P336S7-85-C-0020 

P336S7-85-C-01S3 

P336S7-86-C-0012 

P33657-86-C-0039 

P336S7-86-C-0103 

P33657-86-C-0149 

P33657-86-C-0158 

P336S7-86-C-0182 

P336S7-86-C-2121 

P33657-86-C-2141 

F33657-87-C-0001 

P33657-87-C-0103 

F336S7-87-C-0168 

P33657-87-C-2092 

F33657-88-C-0008 

F33657-88-C-0029 

F33657-88-C-0091 

F33657-88-C-0122 

F33657-89-C-0014 

P33657-89-C-0018 

F33657-89-C-0039 

P33657-91-C-0062 


A- 10  Trainer  Flight  Simulator 

Con^ass  Cope  Development  Program 

F-16  Digital  Radar  Land  Mass  Simulator  (DRLMS) 

MATE  System  and  Supporting  Tasks 

C-5A/C-141B  Air  Refuelling  Part  Task  Trainer  (ARPTT) 
Ground  Power  Generator 

Sonobuoy  Missile  Impact  Location  System  (SMZLS) 
Aircraft  Modification  auid  Support  Segment  (AMSS) 

KC-135  OFT  Refurbishment 

Advanced  Range  Instrumentation  Aircraft  (ARIA)  Optics 
System 

Short  Range  Attack  Missile  (SRAM  II)  (A(94-131A) 

Air  Force  One  (AF-1) 

C-130  Aircrew  Training  System  (ATS) 

Modular  Simulator  Project,  Phase  III,  Part  I 
F-15E  LAMTIRM  Part  Task  Trainer  (PTT) 

Project  2851  Standard  DoD  Simulator  Database  /  CTPD, 
Phase  A 

GBU-IS  Part  Task  Trainer  (PTT) 

F-16  and  A- 10  LANTIRM  Core  Simulator 
MATE  System  Integration  Contract 

Advanced  Tactical  Air  Reconnaissance  System  (ATARS) 
Full  Scale  Development  (FSD) 

F-16  Improved  Electronic  Warfare  Training  Devices 
(lEWTDs) 

Aircrew  Eye/Respiratory  Protection  (AERP)  Systems 
Global  Positioning  System  (GPS)  Digital -Analog- 
Converter  (DAC) 

C-17  Aircrew  Training  System  (ATS) 

Contingency  Airfield  Lighting  System  (CALS) 

EC-18D  Cruise  Missile  Mission  Control  Aircraft  (CMMCA) 
Systems 

Advanced  X-Ray  System  (AXES) 

C-17  Maintenance  Trainers  Development  (MTDs) 

C-141  Aircrew  Training  System  (ATS) 

Simulator  for  Electronic  Combat  Training  (SECT) 
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0T-AF62Q4S 

DI-A-1021 

DI-A-3002 

DI-A-3002A 

DI-A-3007 

DX-A-3009 

DI-A-3023 

DZ-P>3460A 

DI-S-3618 

DI-T-3701A 

DI-T-3703A 

DI-T-3707A 

nDI-E-3935 

DI-P-4802 

DI-A-5004 

DI-A-5004A 

DI-A-5009A 

DI-A-S239B 

OZ-B>5529 

DI-F-6000C 

DI-P-6010A 

DI-L-6138 

DI-P-6162 

DI-S-7017 

DI-L-7017A 

DI-H-7066 

DZ-E-7144 

DI-H-25711B 

DI-H-25772B 

DI-L-30317 

DI-L-30318 

DI-M-30417 

DI-P-30465 

DZ-R-30510 

DI-S-30567A 

DI-S-30595 

DI-T-30714 

DI-T-30715 

DZ-FNCL-80448 

DZ-FNCL-81116 

DI-IZ.SS-80395 

DZ-ZLSS-80531 

DZ-ZLSS-81070 

DZ-MCCR-80014A 

DI-MCCR-80030A 

DZ-M(»IT-80C04 

DZ-MQKT- 80096 


System  Engineering  Master  Schedule  (SEMS) 

Program  Plan 
R&D  Status  Report 
R&D  Status  Report 
Program  Schedule 

Program  Milestones  (Acquisition  Phase) 

Contract  Work  Breakdotoi  Structure 
Manufacturing  Plan 

System  Engineering  Management  Plan  (SBMP) 

System  Test  Plan 

Conqpiuter  Program  Configuration  Item  (CPCZ)  Test 
Plans / Procedures 
General  Test  Plan/Procedures 
Firmware  Develo^nent  Plan  (FDP) 

Quality  Assurance  Prograun  Plan  Requirements 

Project  Status  Report 

Project  Statxis  Report 

Progress  Report 

Management  Plan 

Software  Quality  Assurance  Plan 
Cost  Performance  Report  (CPR) 

Cost/Schedtile  Status  Report 
Integrated  Support  Plan  (ISP) 

DD  Form  610  "GFE  Requirement  Schedule" 

Logistic  Support  Analysis  (LSA)  Plan 

Logistic  Support  Analysis  Plan 

Training  amd  Training  Equipment  Plan 

Simulator  System  Engineering  Management  Plem  (SEMP) 

Training  Development  and  Support  Plam  Report 

Progress  Report 

Logistic  Support  Analysis  (LSA)  Plan 
Integrated  Support  Plan  (ISP) 

Engineering  Management  Report 
Manufacturing  Plan 
Quality  Program  Plan 

Conqiuter  Program  Development  Plan  (CPDP)  Quality 
Assurance  Plan  (QAP) 

Detailed  Research  Plan 

Master  Test  Plan/Program  Test  Plan 

Conq>uter  Program  Test  Plan 

Life  Cycle  Cost  (LCC)  and  Independent  Schedule 
AS:‘?e.-ysment  (ISA)  Report 

Hr<7hour  Estimate,  Technical  Cost  Proposals 
Integrated  Support  Plan  (ISP) 

Logistic  Support  Analysis  Plan 

Training  Program  Development  euid  Management  Plan 

Software  Test  Plan 

Software  Development  Plan 

Management  Plan 

Management  Plan 
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DZ-MQMT-80227  Contractor's  Progress,  Status  and  Hanagement  Report 

DZ-MGMT-80368  Status  Report 

DZ-MQMT-8047S  Contract  Requirements  Zmplementation  Plan 

DZ-MatT-80476  Training  Development  and  Support  Plan 

DZ-MGKT-80505  Program  Evaluation  ud  Review  Techniqpie  (PERT)  /  Time 

Network  Diagram 

DZ-MGMT-80506  Program  Evaluation  and  Review  Technique  (PERT)  /  Time 

Analysis  Report 

DZ-MGKT-80507A  Project  Planning  Chart  li 

DZ-MQMT-80555  Program  Progress  Report 

DZ-M(S4T- 80615  Technical  Progress  Report 

DZ-MCa4T- 80909  Program  Plan 

DZ -MONT- 81024  System  Engineering  Management  Plan  (SEMP) 

DZ-MOtT- 81117  Technical  and  Management  Nork  Plan 

DZ-MZSC- 80074  Manufacturing  Plan 

DZ-MZSC-80167A  Contract  Data  Status  and  Schedule  Report 
DZ-MZSC-81183  Master  integrated  Program  Schedule  (MIPS) 

DZ-NDTZ-80808  Test  Plans/Procedures 
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CMO 

FVALUBl 

FVALDB2 

ODPDFL 

FV87CDOL1 

FV87CDOL2 

MOONITS 

OCOSTCD 

CTWB 

D_DP 

PRODOPT 

SCHBDPBR 

SCHBDMOO 

SCHBDPLR 

NOBCPS 

PLPRBSCH 

PLAOQR 

PLCCBIC 

PliSRISK 

PLTRISK 

COMPLBX 

PAQBSSON 

HODIDS 

PLMBSDBV 

plWbsu 

PLNBSLL 

PLORRFP 

TBCBDBFN 

SONDNBS 

SOWCSSR 

SONSDZSP 

SONRCIfP 

SONRCBP 

SOWFRSI 

MOPMDIDS 

MOBVCRIT 

BVRISKS 

BVSDISP 

BVRCHP 

BVRCBP 

BVRBSP 


Contract  Runbar 

Paca  Valua  o£  tha  Contracts 

Faca  Valua  of  tha  Contracts,  Adjusted  for  Contract 

Nusibar  86-C-0039 

Qroas  Doowstic  Product  Deflator 

PVALUBl  Converted  to  1987  constant  Dollars 

FVAUJB2  Converted  to  1987  Constant  Dollars 

Nunbar  of  Davalopnantal  units  Procured 

Unit  Cost  in  1987  constant  Dollars 

Contract  Type 

Davalopoiant  /  Development  and  Production 
Production  Options 
Schedule  Performance 
Schedule  Performance  (Modified) 

Schedule  Performance  Converted  to  a  Binary  Variable 

Number  of  Contract  Modifications 

Pre  -  schedxiled 

Aggressive 

Concurrency 

Schedule  Risk 

Technical  Risk 

Conqplexity 

Number  of  Pages  in  the  SOW 
Number  of  DIDs 
Preliminary  WBS  Developed 

Number  of  Blements  at  Level  Three  of  the  WBS 
Lowest  Level  Developed  of  the  WBS 
Draft  RFP 

Degree  of  Technical  Definition 
Develop  WBS  Further 
C/SSR  Required 
SOW  Schedule  Display 

SOW  Resource  Constraints  within  a  Program 

SOW  Resource  Constraints  Between  Programs 

Frequency  of  Reporting  Schedule -Management  Information 

Nundoer  of  Project -management  DIDs 

Number  of  Bvaluation  Criteria 

Bvaliiatlon  of  Schedule  Risks 

Bvaluation  Schedule  Display 

Bvaluation  Resource  Constraints  Within  a  Program 
Bvaluation  Resource  Constraints  Between  Programs 
Bvaluation  Responsibility  Allocation 


CASK 

ca«o 

FVALUBl 

FVALDB2 

GDPDBFL 

FV87C3X)L1 

FV87CDOL2 

1 

760103 

6961.0 

6961.0 

0.5730 

12.148 

12.148 

2 

760792 

77246.9 

77246.9 

0.5730 

134.81 

134.81 

3 

812041 

6640.4 

6640.4 

0.8230 

8.0686 

8.0686 

4 

812107 

54806.6 

54806.6 

0.8230 

66.594 

66.594 

5 

832141 

8812.3 

8812.3 

0.9220 

9.5578 

9.5578 

6 

832217 

12900.0 

12900.0 

0.9220 

13.991 

13.991 

7 

840117 

6643.0 

6643.0 

0.9560 

6.9488 

6.9488 

8 

850020 

17114.8 

17114.8 

0.9790 

17.482 

17.482 

9 

850153 

7808.0 

7808.0 

0.9790 

7.6440 

7.6440 

10 

860012 

214438.0 

214438.0 

0.9900 

216.60 

216.60 

11 

860039 

249815.0 

38000.0 

0.9900 

252.34 

38.384 

12 

860103 

31442.6 

31442.6 

0.9900 

31.760 

31.760 

13 

860149 

2830.6 

2830.6 

0.9900 

2.8591 

2.8591 

14 

860158 

6696.6 

6696.6 

0.9900 

6.7642 

6.7642 

15 

860182 

5198.7 

5198.7 

0.9900 

5.2512 

5.2512 

16 

862121 

11196.0 

11196.0 

0.9900 

11.309 

11.309 

17 

862141 

25481.0 

25481.0 

0.9900 

25.738 

25.738 

18 

870001 

24883.0 

24883.0 

1.0000 

24.883 

24.883 

19 

870103 

118624.1 

118624.1 

1.0000 

118.62 

118.62 

20 

870168 

9899.3 

9899.3 

1.0000 

9.8993 

9.8993 

21 

872092 

10573.0 

10573.0 

1.0000 

10.573 

10.573 

22 

880008 

4838.6 

4838.6 

1.0280 

4.7069 

4.7069 

23 

880029 

57489.9 

57489.9 

1.0280 

55.924 

55.924 

24 

880091 

3156.8 

3156.8 

1.0280 

3.0708 

3.0708 

25 

880122 

42662.9 

42662.9 

1.0280 

41.501 

41.501 

26 

890014 

2287.5 

2287.5 

1.0710 

2.1359 

2.1359 

27 

890018 

54808.4 

54808.4 

i:o7io 

51 . 175 

51.175 

28 

890039 

27958.5 

27958.5 

1.0710 

26.105 

26.105 

29 

910062 

8612.3 

8612.3 

1.1670 

7.3798 

7.3798 
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CASK  NCXJHITS  UCOSTCD 


CTYPB 


D  DP  PROOOPT  SC3IEDPBR 


1 

1 

12.148 

2 

0 

1 

94.8 

2 

3 

44.937 

3 

0 

0 

M 

3 

1 

8.0686 

2 

0 

1 

-10.0 

4 

2 

33.297 

2 

0 

1 

M 

5 

1 

9.5578 

2 

0 

1 

131.9 

6 

3 

4.6638 

1 

0 

0 

13.0 

7 

1 

6.9488 

1 

1 

1 

13.4 

8 

1 

17.482 

1 

0 

0 

24.2 

9 

4 

1.9110 

1 

1 

0 

23.8 

10 

30 

7.2201 

2 

0 

1 

M 

11 

2 

19.192 

1 

1 

0 

74.4 

12 

2 

15.880 

1 

1 

0 

116.7 

13 

1 

2.8591 

2 

0 

0 

-27.9 

14 

1 

6.7642 

1 

0 

1 

32.4 

IS 

1 

5.2512 

4 

0 

0 

30.0 

16 

1 

11.309 

2 

0 

1 

35.3 

17 

1 

25.738 

2 

0 

1 

29.5 

18 

1 

24.883 

4 

0 

0 

M 

19 

11 

10.784 

1 

0 

1 

119.3 

20 

17 

0.5823 

1 

1 

1 

16.0 

21 

104 

0.1017 

1 

0 

1 

263.0 

22 

26 

0.1810 

1 

1 

0  . 

18.3 

23 

3 

18.641 

1 

0 

1 

46.8 

24 

2 

1.5354 

1 

0 

1 

334.0 

25 

2 

20.750 

1 

0 

0 

139.7 

26 

6 

0.3560 

1 

0 

1 

81.3 

27 

12 

4.2646 

2 

0 

1 

64.2 

28 

2 

13.053 

1 

0 

1 

65.7 

29 

1 

7.3798 

3 

0 

0 

39.4 
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CASH 

SCHBDMOD 

SCHBDPLR 

NOBCPS 

PLPRBSCH 

PLAGCK 

PliCONC 

1 

94.8 

1 

39 

1 

0 

1 

2 

M 

M 

M 

1 

0 

0 

3 

o 

o 

H 

1 

0 

8 

1 

1 

1 

4 

M 

M 

M 

1 

1 

1 

5 

131.9 

1 

28 

0 

0 

1 

6 

13.0 

0 

25 

1 

0 

0 

7 

13.4 

0 

20 

1 

0 

0 

8 

24.2 

0 

13 

1 

0 

1 

9 

23.8 

0 

8 

1 

0 

1 

10 

M 

M 

M 

1 

1 

1 

11 

74.4 

1 

51 

1 

1 

0 

12 

116.7 

1 

44 

0 

0 

0 

13 

-27.9 

0 

5 

1 

0 

0 

14 

32.4 

0 

11 

1 

0 

1 

IS 

30.0 

0 

16 

1 

0 

0 

16 

35.3 

1 

8 

1 

0 

1 

17 

29.5 

0 

13 

1 

0 

1 

18 

M 

M 

M 

1 

0 

0 

19 

119.3 

1 

85 

1 

0 

0 

20 

16.0 

0 

14 

1 

1 

0 

21 

M 

1 

16 

1 

1 

1 

22 

18.3 

0 

20 

1  . 

0 

0 

23 

46.8 

1 

19 

0 

0 

1 

24 

M 

1 

35 

0 

0 

0 

25 

139.7 

1 

95 

1 

1 

0 

26 

81.3 

1 

23 

0 

0 

0 

27 

64.2 

1 

28 

1 

1 

1 

28 

65.7 

1 

53 

1 

0 

0 

29 

39.4 

1 

34 

1 

0 

0 

E-4 


CASK 

PLSRZSK 

PLTRISK 

COMPLEX 

PAGESSOW 

NODIDS 

PLWBSDEV 

1 

1 

1 

2 

30 

76 

1 

2 

2 

2 

3 

36 

101 

1 

3 

3 

3 

2 

45 

100 

1 

4 

4 

3 

3 

30 

58 

1 

5 

3 

3 

2 

62 

88 

1 

6 

2 

2 

2 

30 

57 

0 

7 

3 

1 

2 

68 

62 

0 

8 

2 

1 

3 

42 

68 

1 

9 

1 

1 

1 

70 

92 

1 

10 

3 

3 

2 

77 

140 

1 

11 

1 

1 

3 

21 

86 

1 

12 

3 

1 

3 

39 

41 

1 

13 

3 

3 

1 

17 

25 

1 

14 

2 

1 

2 

43 

55 

1 

IS 

3 

3 

2 

25 

37 

1 

16 

3 

3 

2 

49 

77 

1 

17 

3 

3 

3 

56 

69 

1 

18 

3 

3 

3 

25 

37 

1 

19 

3 

3 

2 

87 

25 

1 

20 

3 

1 

1 

34 

59 

0 

21 

S 

2 

1 

16 

SO 

0 

22 

1 

3 

1 

39 

80 

1 

23 

3 

3 

3 

25 

39 

1 

24 

1 

2 

1 

19 

51 

0 

25 

3 

3 

3 

25 

59 

1 

26 

1 

2 

1 

40 

73 

0 

27 

3 

3 

2 

40 

58 

1 

28 

1 

1 

2 

26 

40 

1 

29 

1 

3 

2 

25 

48 

1 

E-5 


CASE  PLNBSL3  PLWBSLL  PLDRRFP  TECHDEFN  SOWDNBS  SOWCSSR 


17  4 

2  21  4 

3  17  3 

4  11  4 

5  36  3 

6  0  0 

7  0  0 

8  12  3 

9  17  4 

10  35  3 

11  12  S 

12  6  4 

13  17  4 

14  11  4 

15  0  2 

16  15  4 

17  14  4 

18  19  6 

19  44  5 

20  0  0 

21  0  0 

22  70  5 

23  10  5 

24  0  0 

25  4  4 

26  0  0 

27  8  4 

28  9  5 

29  12  3 
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CASE  SOWSDISP  SONRCHP  SOtfRCBP 


SOWFRSI  NOPMDIDS  NOBVCRIT 


■» 


A 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 
29 


1 

1 

1 

1 

1 

0 

1 

1 

1 

1 

1 

1 

1 

1 

1 

0 

0 

0 

0 

1 

0 

1 

1 

0 

1 

0 

1 

1 

1 


0 

0 

1 

0 

1 

1 

0 

1 

0 

0 

1 

1 

1 

1 

0 

1 

1 

0 

1 

1 

0 

1 

1 

1 

0 

1 

1 

1 

1 


0 

0 

1 

0 

1 

1 

0 

1 

0 

0 

1 

0 

0 

1 

0 

1 

1 

0 

1 

1 

0 

1 

1 

1 

0 

0 

1 

1 

1 


3 

1 

3 

3 

3 

5 

3 

3 

3 

3 

2 

3 

3 

3 

2 

3 

3 

1 

3 

3 

3 

2 

3 

3 

3 

3 

3 

3 

3 


5 

5 
9 

10 

11 

4 

3 
7 

7 

16 

8 

12 

4 
8 

6 

11 

9 

4 

5 

7 

6 
9 

8 
6 
6 
7 

10 

7 

9 


3 

3 
2 
9 

5 

4 

3 

6 

4 

12 

2 

3 

1 

10 

5 
2 
2 

3 

4 

11 

5 
3 
3 
2 
2 
7 
2 
3 
5 
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E-7 


CASH  EVRISKS  EVSDISP 


BVRCWP 


EVRC3P 


EVRESP 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 
29 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

0 

1 

1 

1 

1 

1 

0 

1 

1 

1 

1 

1 


* 


E-8 


Satis  Fhit  of  SCBBDRB  II NORFS 


Satter  FM  of  SCBEOyOD  a  NORFS 


+  + 


p- 


F-6 


BaltJUr  Flat  NOOIB  «  PAGBSOff 


«■ 


F-9 


For  the  partial  F  test,  at  each  step  of  the  stepwise  model - 
building  process,  the  F  distribution  has  1  degree  of  freedom  for  the 
numerator  and  (n-p-1)  degrees  of  freedom  for  the  denominator,  trhere  n  is 
the  sample  size  and  p  is  the  number  of  variables  in  the  full  model  at 
the  relevamt  step.  (Mote  that  an  ordinal  variable,  when  decomposed  into 
a  set  of  dummy  variables  for  a  regression  model,  changes  both  the 
numerator  and  denominator  degrees-of-freedom  for  the  F  test  by  the 
number  of  dummy  variables  in  the  set.)  For  the  sample  size  of  25  in 
this  research,  n  ■  25  and  p  changes  as  variables . enter  or  leave  the 
model.  At  the  first  step,  p  «  0  so  the  degrees  of  freedom  for  the 
denominator  is  (25-0-1)  «  24.  The  degrees  of  freedom  for  the 
denominator  is  reduced  by  one  for  each  variable  added  to  the  model. 

The  following  results,  obtained  from  the  Statistix  4.0  statistical 
software  package,  study  the  change  in  the  F  distribution  F  value  and 
p  value  with  change  in  the  denominator  degrees  of  freedom  (Analytical 
Software,  1992:302). 

An  F-value  of  3  to  Enter  or  Ranove  Variables. 


FPROB 

(3, 

1, 

24) 

0.09610 

FPROB 

(3, 

1, 

23) 

0.09666 

FPROB 

(3, 

1, 

22) 

0.09726 

FPROB 

(3, 

1, 

21) 

0.09793 

FPROB 

(3, 

1, 

20) 

0.09866 

FPROB 

(3, 

1. 

19) 

0.09947 

FPROB 

(3, 

1, 

18) 

0.10037 

FPROB 

(3, 

1, 

17) 

0.10137 

A  p-value 

of  0 

.1 

to  Enter 

or  Remove 

FIMVERSE 

(0.9, 

1, 

24) 

2.93 

FINVERSE 

(0.9, 

1, 

23) 

2.94 

FIMVERSE 

(0.9, 

1, 

22) 

2.95 

FIMVERSE 

(0.9, 

1. 

21) 

2.96 

FIMVERSE 

(0.9, 

1, 

20) 

2.97 

FIMVERSE 

(0.9, 

1, 

19) 

2.99 

FIMVERSE 

(0.9, 

1, 

18) 

3.01 

FIMVERSE 

(0.9, 

1, 

17) 

3.03 

With  the  sample  size  of  25  auid  the  expected  range  of  the  number  of 
varied>les  to  be  fitted  for  a  meaningful  model,  the  preceding  results 
demonstrate  that  an  F  value  of  3  and  a  p  value  of  0.1  are  approximately 
equivalent . 
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Appendix  H:  BMDP  2R  Stepwlae  Regreaeion  r>n  srHgnpKR.  Full 
Wo  Interaction  Terma  (Edited  Data  Output) 


PROOtMl  IMSTROCTIOHS 


/nmiT  riLB>‘TKISIS.ASC' . 

VMUABIilS-33 . 

roRmT-nm. 

^  /VMUABU  mNU-CHO,  SCHIDPIII,  SCHDHOO.  SCHIDPLR.  OCOSTCD, 

cnm.  D  DP,  PROOOPT,  MOICPS,  PLniSCH,  PLMOR,  PLCOMC, 
PLSIU8X,~PLT1USK.  CONPLEC.  PM3ISS0W.  H0OXO8,  PLMBSDEV, 
PUn8L3.  PUOSLL,  PUffiltPP,  TICHDIPM.  SOWJHBS,  SOHCSSR, 
S0W8DZSP.  SOMRCNP,  SONRCBP,  SONfeSI.  NOPMDZOS,  NOIVCXZT, 
IVSOZSP,  IVIlCtfP.  IVRCBP. 


OSI-SCHIDPIR.  OCOSTCD,  CTTPI,  D_DP,  PRCOOPT,  MOSCPS, 
Pl,PilSSCH,  PLAOOR,  PLCOMC,  PLEuIk,  PLTRISK,  COMPLHX, 
PMXUSOM,  MODIDS,  PLNBSDKV,  PLNBSL3,  PLI»ltFP.  TBCHDBFN, 
SONDNBS,  S0WC88R,  SOWSDZSP,  SOMRCNP,  SONRCBP,  SONPRSZ, 
MOPMDZDS,  MOIVCRZT.  BVSDZSP,  RVRCNP,  BVRCBP,  PLSRZSKl, 
PLSRZSia,  PLTRZSXl,  PLT1USK3.  COMPLtXl,  COMPLSXa,  TBCHDBFl, 
TRCRDRF3,  TBCBDRP3,  PLNBSL31,  PLNBSL32,  PLNBSL33. 


/TRANSFORM  ZF (PLSRZSK 

BQ 

1) 

ZF (PLSRZSK 

BQ 

2) 

ZF (PLSRZSK 

BQ 

3) 

ZF (PLTRZSK 

BQ 

1) 

ZF (PLTRZSK 

BQ 

2) 

ZF (PLTRZSK 

BQ 

3) 

XF(CaMPLRX 

BQ 

1) 

ZF (COMPLEX 

BQ 

2) 

ZF(COMPLBX 

BQ 

3) 

TMBI(PLSRZ8IC1«0. 

THBKPLSRZSKl-l. 

THBH(PLSRZSK1>0. 

TBBKPLTRZSXl-O. 

TRBN(PLTRZSK1-Z. 

THBt(PLTlUSKl-0. 

THRIKCOMPLBXX-O . 
TKBN(CaMPLE(Z-3. 
THDI(C0MPUDCl-0. 


PLSRZSIC3«0 . )  . 
PLSRZSIQ-0 . )  . 
PLSRZSK2-1.)  . 

PLTRZSIC3>0 . )  . 
PLTRZSK2>0 . )  . 
PLTRZSia-1 . )  . 


COMPLBXS-O.) . 
C0MPLBX2-0.) . 
CCMPLBaC2-l.)  . 


ZFCTBCHDBPN  BQ  1)  THBN(TBCHDBPl-0 .  TBCBDBF2-0.  TBCHOBF3-0 . ) . 
ZF  (TBCHDBFN  BQ  2)  THBN (TBCHDBFl-l .  TBC3iDBF2-0  .  TBCHDBP3>0 . )  . 
ZF(TBC8DBFN  BQ  3)  THBN (TBCBDBFl-0 .  TBCKDBP2-1.  TBCHDBP3-0 . ) . 
ZF (TBCHDBFN  BQ  4)  THBN (TBCHDBFl-0 .  TBCHDBF2-0.  TBCHDBF3-1. ) . 


ZF(PLNBSL3  BQ  0)  TKBN(PLHBSL31«0 .  PLNBSL32-0.  PLNBSL33-0 . ) . 
ZF(PLHBSL3  GT  0  AMD  PLWBSL3  LB  10)  THBN (PLMBSL3 1-1 .  PLMBSL32-0 
ZF(PLNBSL3  OT  10  AMD  PLHBSL3  LB  16)  THBN(PLWBSL31-0 .  PLNBSL32-: 
ZF(PLNB8L3  OT  16)  THBN(PLNBSL31-0 .  PLIIBSL32-0.  PLNBSL33-1. )  . 

/GROUP  C00BS(0_DP,  PRODOPT,  PLPRBSCH,  PLNBSDBV,  PLDRRFP,  SONDNBS, 
SONSDZSP,  SOMRCNP,  BVSDZSP,  CTTPB,  VIAOOR.  PLCOMC,  SONCSSR, 
SONRCBP,  SONFRSZ,  BVRCNP,  BVRCBP,  PLSRZSKl,  PLSRZSX2, 

PLTRZSKl,  PLTRZSK2,  COMPLBXl,  C0MPLBX2,  PLHBSL31,  PLNBSL32, 
PLNBSL33,  TBCHDBFl,  TBCHDBF2,  TBCBDBF3) -1, 0 . 


NAMES (D  DP,  PRODOPT,  PLPRBSCH,  PLNBSDBV,  PLDRRFP,  SONDNBS, 
SONSDZSP,  SOMRCNP,  BVSDZSP,  CTTPB,  PLAO(Hl,  PLCOMC,  SONCSSR, 
SONRCBP,  SONFRSZ,  BVRCNP,  BVRCBP.  PLSRZSKl,  PLSR1SK2, 
PLTRZSKl,  PLTRZSK2,  COMPLBXl,  C0MPLBX2.  PLNBSL31,  PLNBSL32, 
PLNBSL33,  TBCHDBFl,  TBCHOBF2,  TBCSDBFl ) -TBS ,  NO. 

CODES (PLSRZSK,  PLTRZSK,  C»MPLBX)«1,  2,  3. 

NAMBS(PLSRZSK,  PLTRZSK) -LON,  LON  MBD,  OTHER. 

NAMES (COMPLEX) -LON,  MBD,  HZ. 


C»DBS (TBCHDBFN) -1,  2,  3,  4. 

NAMES (TBCnDBFM) -DRAFT_A,  FULL_A,  DRAFT_B.  FDLL_B. 
MAMB8(PLNBSL3)-'OMDBR_2' ,  '2_11',  '11_17',  •OVBR_17' . 


PLNBSL33-0.)  . 

.  PLNBSL33-0.) . 
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/RCSRISS  OIPlMD-SCtODPBR. 

scnmiis-SPiiSiizsK,  spltsisx.  sccnplix,  stksdif,  splnbsu. 

SPI|8RZSIC-PI.SRZS1U.,  PLSRISK3. 

SPLTIUSIC-PLTIUSIU,  PLTRZSK2. 

SCONPLSX-COMPIJDCl.  C0MPLIX2 . 

SnCBDIP-TICRDBPl,  TIC3IDIP3.  TBOIDBPS . 

SPLMBSU-PLNBSL31,  PLMBSL32.  PLHBSL33 . 

IMPVAL-O.l,  0.1. 

OimVXL-O.ll,  0.11. 

ZMOtPIHD-CTyPI.  PUkOOR.  PLCOHC.  PASISSOH,  NOOXOS,  PLORRFP, 
SOMCSn.  SOMSCBP.  SOHRSZ.  MOPMDZDS,  HOSVCRZT,  IVRCMP,  BVRCBP, 
0C08TCXI,  S  OP,  PIUSmPT,  MOICPS.  PtPRSSCB,  PLNBSOIV.  SCMOHBS, 
SONSDZSP,  iONRCNP,  IVSDZSP.  SPLSRZSX,  SPLTRZSK,  SCCMPLBX, 
SnCHDIP,  SPLNBSU. 

TOL-0.1. 

/non  LBVBL-MZHZMAL. 

HO  DATA. 

NO  CORRBLATZOH. 

STIP. 

AMOVA. 

NO  COVA. 

HO  PART. 

NO  COBPP. 

NO  FRATZO. 

NO  RRHG. 

CASB-0. 

OZAGMOSTZCS-ALL . 

LZMBSZZB-80 . 

/PLOT  RBSXDOALS. 

DHORMAL. 

SZZB-SO,  35. 

CaiSBPLOTS. 

XVAR-OCOSTCD. 

YVARxCOOK. 

STtPaALL. 

NO  DATA. 

/END 


NOMBBR  OF  CASHS  RBAD .  39 

CASHS  NZTH  DATA  MZSSZNO  OR  BBYOND  LZMZTS  .  .  4 

RBMAXMZNS  NDKBHR  OF  CASHS .  25 
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DUCRIPTrVI  STATISTICS  OF  DATA 


VARIABLE  TOTAL 

STANDARD 

SKEW- 

SMALLEST 

LARGEST 

MO. 

HkNE 

FREQ. 

MEAN 

DEV. 

NESS  KORTOSIS 

VALUE  Z-SCR 

VALUE 

Z-SCR 

3 

SCHEDPER 

3S 

70.768 

81.813 

1.714 

3.733 

-37.900  -1.31 

334.00 

3.33 

S 

OCOSTCD 

35 

9.0161 

7.3135 

0.548 

-0.835 

.10166  -1.33 

35.738 

3.39 

S 

CTTPE 

35 

.36000 

.48990 

0.549 

-1.765 

0.0000  -0.73 

1.0000 

1.31 

7 

D  DP 

35 

.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

8 

PROOOPT 

35 

.60000 

.50000 

-0.384 

-1.935 

0.0000  -1.30 

1.0000 

0.80 

9 

NOECPS 

35 

38.440 

33.863 

1.497 

1.641 

5.0000  -1.03 

95.000 

3.91 

10 

PLPRESCH 

35 

.80000 

.40835 

-1.411 

-0.005 

0.0000  -1.96 

1.0000 

0.49 

11 

PLAOat 

35 

.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

13 

PLCOHC 

35 

.44000 

.50663 

0.337 

-3.035 

0.0000  -0.87 

1.0000 

1.11 

13 

PLSRISR 

35 

3.3400 

.93556 

-0.463 

-1.714 

1.0000  -1.34 

3.0000 

0.83 

14 

PLTRISK 

35 

3.1300 

.93736 

-0.334 

-1.845 

1.0000  -1.31 

3.0000 

0.95 

is 

COMPLEX 

35 

1.9600 

.73485 

0.056 

-1.333 

1.0000  -1.31 

3.0000 

1.43 

16 

PACaSSON 

35 

38.930 

18.316 

0.885 

0.037 

16.000  -1.36 

87.000 

3.64 

17 

NODIDS 

35 

60.600 

30.394 

0.064 

-0.930 

35.000  -1.75 

100.00 

1.94 

18 

PLNBSDEV 

35 

.76000 

.43589 

-1.145 

-0.713 

0.0000  -1.74 

1.0000 

0.55 

19 

PLNBSL3 

35 

13.840 

16.069 

3.057 

4.363 

0.0000  -0.80 

70.000 

3.56 

31 

PLDRRFP 

35 

.80000 

.40835 

-1.411 

-0.005 

0.0000  -1.96 

1.0000 

0.49 

33 

TECHDBFN 

35 

3.6800 

1.1446 

-0.187 

-1.474 

1.0000  -1.47 

4.0000 

1.15 

33 

SONDNBS 

35 

.80000 

.40835 

-1.411 

-0.005 

0.0000  -1.96 

1.0000 

0.49 

34 

SONCSSR 

35 

.40000 

.50000 

0.384 

-1.935 

0.0000  -0.80 

1.0000 

1.30 

3S 

SOWSOISP 

35 

.73000 

.45836 

-0.933 

-1.193 

0.0000  -1.57 

1.0000 

0.61 

36 

SONRCNP 

35 

.76000 

.43589 

-1.145 

-0.713 

0.0000  -1.74 

1.0000 

O.SS 

37 

SONRCBP 

35 

.64000 

.48990 

-0.549 

-1.765 

0.0000  -1.31 

1.0000 

0.73 

38 

SONFRSI 

35 

.88000 

.33166 

-3.300 

3.963 

0.0000  -3.65 

1.0000 

0.36 

39 

MOPMDIOS 

35 

7.3600 

3.3073 

0.133 

-0.763 

3.0000  -1.89 

13.000 

3.01 

30 

NOEVCRIT 

35 

3.9600 

3.4576 

1.418 

1.473 

1.0000  -1.30 

11.000 

3.86 

31 

EVSOISP 

35 

.56000 

.50663 

-0.337 

-3.035 

0.0000  -1.11 

1.0000 

0.87 

33 

BVRCNP 

35 

.80000 

.40835 

-1.411 

-0.005 

0.0000  -1.96 

1.0000 

0.49 

33 

BVRCBP 

35 

.64000 

.48990 

-0.549 

-1.765 

0.0000  -1.31 

1.0000 

0.73 

34 

PLSRISKl 

35 

.13000 

.33166 

3.300 

3.963 

0.0000  -0.36 

1.0000 

3.65 

3S 

PLSRISK3 

35 

.56000 

.50663 

-0.337 

-3.035 

0.0000  -1.11 

1.0000 

0.87 

36 

PLTRISXl 

35 

.16000 

.37417 

1.745 

1.093 

0.0000  -0.43 

1.0000 

3.34 

37 

PLTRISKS 

35 

.48000 

.50990 

0.075 

-3.073 

0.0000  -0.94 

1.0000 

1.03 

38 

COMPLEXl 

35 

.48000 

.50990 

0.075 

-3.073 

0.0000  -0.94 

1.0000 

1.03 

39 

COMPLEXS 

35 

-.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

40 

TECHDEFl 

35 

.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

41 

TECHDEF3 

35 

.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

43 

TBCHDBF3 

35 

.33000 

.47610 

0.736 

-1.530 

0.0000  -0.67 

1.0000 

1.43 

43 

PLHBSL31 

35 

.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

44 

PLWBSL33 

35 

.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

45 

PLNBSL33 

35 

.34000 

.43589 

1.145 

-0.713 

0.0000  -0.55 

1.0000 

1.74 

•  ••hots  KDRTOSIS  VALDBS  ORBATER  THAN  ZERO  INDICATE  A  DISTRIBDTION  IflTM 

HEAVIER  TAILS  THAN  NORMAL  OISTRIBOTION . 


STBP  NO. 


0 


STD.  SmOR  OF  gST.  81.8118 
ANALYSIS  OF  VARIANCB 
RBSIDOAL 
VARXABUtS  IN  BQOATICH 


SDN  OF  SQOARBS 
160836.20 


DF  KSAN  SQOARB 
24  6693. 17S 

VARIABLBS  MOT  IN  EQUATION 


» 


STD. ERR  F  AND  P 

VARIABLE  COEFF.  OF  COEFF  TOL.  REMOVE (L) 


(COISTAMT  70.7680) 


PARTIAL  F  AND  P 

VARIABLE  CORSL.  TOL.  ENTER  (L) 


OCOSTCD  -0.0836 
CTYPE  -0.2596 
D_OP  -0.1893 
P«>DOPT  0.2608 
NOECPS  0.3935 
PLPRBSCH-0.4452 
PLAGOR  0.1434 
PLOMC  -0.0428 
PLSRISK  -0.1037 
PLTRISK  -0.0314 
COMPLEX  -0.1431 
PAQBSSOM-0 . 2173 
MODIDS  -0.1517 
PLWB3DBV- 0.3460 
PLHBSU  -0.1657 
PLDRRFP  -0.3649 
TECHDBFM  0.0493 
SOWDNBS  -0.1459 
SOWCSSR  -0.2076 
SONSDISP- 0.4224 
SONRCHP  -0.1637 
SONRCBP  -0.1018 
SOHFRSI  0.1376 
NOPMDIDS-0.0194 
NOEVCRIT-0.0979 
EVSDISP  0.0762 
BVRCWP  -0.1319 
EVRCBP  -0.0333 

SET  SPLSRISX 
FLSRISKl-0.2191 
PLSRISK2 -0.0230 

SET  5PLTRISK 
PLTRISKl  0.5557 
PLTRISX2 -0.2324 

SET  SCOMPLEX 
COHPLEXl- 0.2196 
C0HPLEX2  0.0078 

SET  5TECHDEF 
TECHDEFl-0.0241 
TBCHDEF2  0.3783 
TECHDEF3 -0.1840 

SET  SPLWBSL3 
PLWBSL31  0.1207 
PLNBSL32-0.2213 
PLNBSL33 -0.1977 


1.0000 

0.16(1} 

1.0000 

1.66(1) 

1.0000 

0.85(1) 

1.0000 

1.68(1) 

1.0000 

4.21(1) 

1.0000 

5.69(1) 

1.0000 

0.48(1) 

1.0000 

0.04 (1) 

1.0000 

0.25(0) 

1.0000 

0.02(0) 

1.0000 

0.48(0) 

1.0000 

1.14(1) 

1.0000 

0.54(1) 

1.0000 

3.13(1) 

1.0000 

0.65(0) 

1.0000 

3.53(1) 

1.0000 

0.06(0) 

1.0000 

0.50(1) 

1.0000 

1.04(1) 

1.0000 

4.99(1) 

1.0000 

0.63(1) 

1.0000 

0.24(1} 

1.0000 

0.44(1) 

1.0000 

0.01(1) 

1.0000 

0.22 (1) 

1.0000 

0.13(1) 

1.0000 

0.41(1) 

1.0000 

0.03 (1) 

F« 

0.75 

P-0. 

.48413(1) 

1.0000 

(1) 

1.0000 

(1) 

F- 

4.91 

P-0. 

.01721(1) 

1.0000 

(1) 

1.0000 

(1) 

F- 

0.77 

P-0. 

.47461(1) 

1.0000 

(1) 

1.0000 

(1) 

F- 

1.27 

P-0. 

.31000(1} 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

F- 

1.10 

P-0. 

.37055(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

A 


m 


■4 


H-4 


STBP  MO. 


1 


VARIABLB  8MTIRSO  SBT  SPLTRISK 

36  PLTRISXI 

37  PLTRISIU 

MULTIPLE  R  0.S5S7 

MOLTZPLB  R-SQOMtB  0.3088 

ADJUSTED  R-SQOARB  0.2459 

STD.  ERROR  OP  EST.  71.0435 

ANALYSIS  OP  VARIANCE 


SUM  OP  SQUARES 

DP 

MEAN  SQUARE 

P 

RATIO 

RESRESSIOM 

49598.297 

2 

24799.15 

4.91 

RESIDUAL 

111037.91 

22 

5047.178 

VARIABLES  IN  EQUATION 

VARIABLES  MOT 

IN 

EQUATION 

STD. ERR  F  AMD  P  PARTIAL  P  AMD  P 

VARIABLE  COEFP.  OP  COEPP  TOL.  REMOVE (L)  VARIABLE  CCffiR.  TOL.  ENTER (L) 


T 


(CONSTANT  51.2667) 

SBT  SPLTRISK 
PLTRISXI  121.5583 
PLTRISK2  0.1083 


Pa  4.91 
PaO. 01721 ;i) 
42.692  0.8242  (1) 

31.3272  0.8242  (1) 


UCOSTCD  0.2223 

CTTYPE  -0.1195 
D_DP  -0.0764 
PRODOPT  0.2265 
NOECPS  0.5230 
PLPRBSCH-0.3359 
PLAGGR  0.1657 
PLCONC  0.0611 
PLSRISK  0.0366 
PLTRZSX  -0.0001 
COMPLEX  0.1281 
PAQBSSOH-0.0S71 
NODIDS  -0.1420 
PLNBSDEV  0.1760 
PLHBSL3  0.0444 
PLORRPP  -0.4205 
TBOIDEFN  0.1744 
SOWDWBS  0.2822 
SOWCSSR  -0.0141 
SOHSDISP-0.0600 
SOHRCNP  -0.1932 
SONRCBP  -0.0384 
SONPRSI  0.0588 
NOPMDIDS  0.1981 
NOBVCRIT-0.1985 
BVSDISP  0.2856 
EVRCHP  -0.1279 
EVRCBP  -0.1081 

SBT  SPLSRISK 
PLSRISKl-0.4067 
PLSRISX2  0.1821 

SBT  SCOHPLBX 
COMPLBXl-0.1337 
C0MPLBX2  0.1796 

SET  STECHDBP 
TBCHDBPl-0.0362 
TECKDBP2  0.2911 
TBCKDEP3- 0.0223 

SET  SPLWBSL3 
PLWBSL31  0.3202 
PLHBSL32-0.1059 
PLNBSL33-0.0811 


0.7995(0 

.308) (1) 

0.6173 

0.30(1) 

0.6884 

0.12(1) 

0.9815 

1.14(1) 

0.9935 

7.91(1) 

0.8889 

2.67(1) 

0.9990 

0.59(1) 

0.9695 

0.08(1) 

0.7931 

0.03(0) 

0.0000 

0.00(0) 

0.8145 

0.35(0) 

0 . 9040 

0.07(1) 

0.9799 

0.43(1) 

0.3411 

0.67(1) 

0.7465 

0.04 (0) 

0.9167 

4.51(1) 

0.9639 

0.66(0) 

0.6389 

1.82(1) 

0.7037 

0.00(1) 

0.4464 

0.08(1) 

0.9686 

0.81(1) 

0.9500 

0.03 (1) 

0.9680 

0.07(1) 

0.8653 

0.86(1) 

0.8485 

0.86(1) 

0.9199 

1.87(1) 

0.9167 

0.35(1) 

0.9790 

0.25(1) 

Pa 

2.05 

PaO. 

15512(1) 

0.8733 

(1) 

0.7170 

(1) 

Pa 

0.34 

PaO. 

71413 (1) 

0.9437 

(1) 

0.9320 

(1) 

Pa 

0.75 

PaO. 

53418(1) 

0.9686 

(1) 

0.9077 

(1) 

0.8987 

(1) 

P- 

0.80 

PaO. 

51159(1) 

0.9320 

(1) 

0.9320 

(1) 

0.8346 

(1) 

H-5 


STEP  HQ 


3 


VMUABLI  BmUO 


9  NOBCPS 


MDLTZPLB  R  0 . 7056 
MOLTZPLI  R-SQOMtB  0.4978 
ADJDSnO  R-SQOMUt  0.4261 


STD.  BRROR  OF  BST. 


61.9781 


ANALYSIS  OP  VARIANCB 


SDM  OF  SflOARBS 

OF 

MEAN  SQOARE 

RBORESSICW 

79969.141 

3 

26656.38 

RESZDDAL 

80667.063 

31 

3841.389 

F  RATIO 
6.94 


VARIABLES  IN  BQaATION 


VARIABLES  MOT  IN  BQOATIOM 


STD. ERR  F  AMD  P  PARTIAL  F  AMD  P 

VARIABLE  COBFF.  OF  COBFF  TOL.  RBMOVB(L)  VARIABLE  CX«R.  TOL.  BRTER(L) 


(COMSTAMT  7.3830) 

MOBCPS  1.5611  0.5552  0.9935  7.91(1)  gCOSTCD  0.0188  0.6735  O.Ox(l) 


SET  SPLTRZSK 
PLTRZSKl  126.8053 
PLTRZS1C2  -3.7103 


F- 

P>0 

37.291  0.8221 
37.3483  0.8231 


7.17 


00423(1) 

(1) 

CTYPB  0.1296 

0.5083 (0.565) (1) 

(1) 

D  DP  -0.0480 

0.6852 

0.05(1) 

PRODOPT  0.3219 

0.9736 

2.31(1) 

PLPRESCH-0.3609 

0.8862 

3.00(1) 

PLAQ6R  0.0894 

0.9690 

0.16(1) 

PLCONC  0.3993 

0.7637 

3.79(1) 

PLSRISX  0.1124 

0.7831 

0.26(0) 

PLTRISK  -0.0002 

0.0000 

0.00(0) 

COMPLEX  -0.0751 

0.7095 

0.11(0) 

PAGBSSOH-0.0763 

0.9038 

0.12(1) 

NODIOS  0.0016 

0.9063 

0.00(1) 

PLHBSDBV  0.1099 

o.33;;4 

0.24(1) 

PLWBSL3  0.0164 

0.7440 

0.01(0) 

PLDRRFP  -0.2869 

0.7915 

1.79(1) 

TBCHOBFN  0.3969 

0.8849 

3.74(0) 

SOHDNBS  0.2763 

0.6336 

1.65(1) 

SOHCSSR  0 . 1872 

0.6333 

0.73(1) 

SOWSOISP-0.0109 

0.4422 

0.00(1) 

SOHRCNP  -0.1620 

0.9575 

0.54(1) 

SONRCBP  -0.0115 

0.9472 

0.00(1) 

S0HFR5I  0.0657 

0.9680 

0.09(1) 

NOPMDIDS  0.3386 

0.8416 

2.59(1) 

MOBVCRIT- 0.0984 

0.8062 

0.20(1) 

BVSDISP  0.1551 

0.8341 

0.49(1) 

BVRCHP  -0.0788 

0.9041 

0.13(1) 

BVRCBP  -0.0366 

0.9576 

0.03(1) 

F- 

1.72 

SET  SPLSRZSK 

P>iO. 

.20583 (1) 

PLSRISKl- 0.3680 

0.8422 

(1) 

PLSRISK3  0.2380 

0.7159 

(1) 

F> 

0.38 

SET  SCOMPLEX 

P-0. 

.69209(1) 

CGMPLBXl- 0.1760 

0.9428 

(1) 

COMPLEX!  0.0501 

0.8667 

(1) 

F- 

1.75 

SET  STBCHDBF 

P-0. 

.19183(1) 

TECHDEFl-O . 2844 

0.8413 

(1) 

TBCHDBF2  0.3391 

0.9073 

(1) 

TBCRDBF3  0.2124 

0.7789 

(1) 

F- 

0.10 

SET  SPLNBSL3 

P-0. 

.95870(1) 

PLNBSL31  0.1105 

0.7420 

(1) 

PLNBSL32-0.0068 

0.8978 

(1) 

PLNBSL33-0.0286 

0.8247 

(1) 

H-6 


STEP  NO. 


3 


VMUABLK  WmilD  12  PLOSIC 

NOLTIPUt  R 
MOLTIPLI  R-SQCaUiB 
ADJUSTB)  R-SQORRB 

STD.  IRROR  OF  BST. 

ANALYSIS  OP  VARXANCB 

RNSRSSSZCN 
RISIDOAL 


0.7602 

0.S779 

0.4935 

58.2263 


STM  OF  SQTIARIS 

92830.211 

67806.000 


DF 

4 

20 


MBAM  SQOARB 
23207.55 
3390.300 


F  RATIO 
6.85 


VARIABLIS  IN  BQOATIOH 


VARIABLRS  NOT  IN  BQOATION 


VARIABLE 

COEFF. 

STS. ERR  F  AND  P 

OF  COEFF  TOL.  REMOVE (L) 

PARTIAL  t 

VARIABLE  CCBtR.  TOL. 

'  AMD  P 
ENTER (L) 

((X3NSTANT 

-30.6792) 

NOBCPS 

2.0884 

0.5877 

0.7826  12.63(1) 

tJCOSTCD  -0.1589 

0.5742 

0.49(1) 

PLCONC 

52.2856 

26.8449 

0.7637  3.79(1) 

CTYPB  0.0646 

0.4921 

0.08(1) 

F-  9.53 

SET  SPLTRISK 

P-0. 00124(1) 

PLTRISXl 

138.7444 

35.566 

0.7977  (1) 

D  DP  0.1815 

0.5242(0 

.431)  (1) 

PLTRISK2 

-6.5672 

25.7688 

0.8182  (1) 

PRODOPT  0 . 1793 

0.7889 

0.63 (1) 

PLPRRSCH-0.3756 

0.8846 

3.12(1) 

PLASGR  0.0236 

0.9409 

0.01(1) 

PLSRISK  0.0639 

0.7686 

0.08 (0) 

PLTRZSK  -0.0002 

0.0000 

0.00(0) 

COMPLEX  -0.2347 

0.6358 

1.11(0) 

PAGBSSOH- 0.1820 

0.8612 

0.65(1) 

NODIDS  -0.1666 

0.7884 

0.54(1) 

PLHBSDBV- 0.0678 

0.2747 

0.09(1) 

PLHB5L3  0.0324 

0.7432 

0.02(0) 

PLDRRFP  -0.2365 

0.7644 

1.13(1) 

TBCHDBFN  0.2870 

0.7528 

1.71(0) 

SONOHBS  0.1993 

0.5944 

0.79(1) 

SOWCSSR  0.1658 

0.6282 

0.54(1) 

SONSDZSP  0.0791 

0.4236 

0.12(1) 

SOHRCHP  -0.1136 

0.9366 

0.25(1) 

SOWRCBP  -0.0675 

0.9324 

0.09(1) 

SOWFRSI  -0.1222 

0.7978 

0.29(1) 

NOPMDIDS  0.2569 

0.7746 

1.34(1) 

NOBVCRIT-0 . 0835 

0.8038 

0.13(1) 

BVSDISP  0.0469 

0.7663 

0.04 (1) 

BVRCNP  -0.3117 

0.7259 

2.04 (1) 

BVRCBP  -0.1895 

0.8592 

0.71(1) 

SET  SPLSRISK 
PLSRISlCl-0.4806 
PLSRISX2  0.2293 

SET  SCOMPLEX 
COIIPLEXl-0.2394 
C0MPLEX2- 0.0247 

SET  STECHDEF 
TECRDEFl-0.2394 
TECHDEF2  0.3023 
TECHDEF3  0.1084 

SET  SPLWBSL3 
PLNBSL3 1-0. 0126 
PLNBSL32-0.0802 
PLNBSL33-0.0122 


F>  2.80 

P-0. 08709(1) 
0.8189  (1) 

0.7123  (1) 

F-  1.27 

P-0. 30578(1) 
0.9323  (1) 

0.8383  (1) 

F-  1.03 

P-0.40274 (1) 
0.8167  (1) 

0.8904  (1) 

0.7115  (1) 

F-  0.15 

P-0.92588 (1) 
0.6732  (1) 

0.8735  (1) 

0.8231  (1) 


H-7 


STSP  NO. 


4 


VMIZASLI  INTBtBD  SIT  SVLSRISX 

34  PLSRISXl 

35  PLSRISIU 


MOLTIPLI  R 
MOLTZPLI  R-SOORRR 
ADJ08TID  R-SQOARI 


0.8235 

0.4782 

0.5709 


StS.  BWOl  OF  BST.  53.5928 


AHALYSZS  OF  VARZANCB 


SOM  OF  SQOARBS 

OF 

MBAN  SQOARB 

RBCBUESSIOH 

108934.75 

4 

18154.13 

RBSZOOAI. 

51499.457 

18 

2872.192 

F  RATIO 
4.32 


VARZABLIS  IN  aQaATIOH 


VARZAB1.IS  NOT  IN  BQOATION 


VARIABLB 

COBFF. 

STD.BRR 

OF  COBFF  TOL. 

F  AND  P 
RBMOVB(L) 

VARIABLB 

PARTIAL 

CORR.  TOL. 

F  AMD  P 
BHTBR(L) 

(CONSTANT 

-14.9594) 

NOBCPS 

1.9754 

0.5437 

0.7747 

13.21(1) 

OCOSTCD 

-0.0959 

0.5475 

0.14(1) 

PLCOHC 

40.7524 

25.2487 

0.7302 

5.78(1) 

CTYPB 

-0.0341 

0.4444 

0.02(1) 

F- 

2.80 

SBT  SPLSRZSX 

P-0 

.08709(1) 

PLSRISXl 

-80.3200 

38.437 

0.7344 

(1) 

D_DP 

-0.0243 

0.4338(0.915) (1) 

PLSRZSX2 

10.4097 

24.9803 

0.4405 

(1) 

F- 

12.88 

SBT  SPLTRZSX 

P-0 

.00034(1) 

PLTRISXl 

143.1249 

32.805 

0.7943 

(1) 

PRODOPT 

-0.0232 

0.4351(0.925) (1) 

PLTRISX2 

-29.9874 

27.2448 

0.4191 

(1) 

PLPRBSCH-0.2944 
PLAOffll  -0.1334 
PLSRISK  0.0001 
PLTRISX  -0.0003 
OMPLSX  -0.0873 
PAOBSSOW- 0.2141 
NCaOIDS  -0.2748 
PLH8SDBV  0.1227 
PIMBSL3  0.1324 
PLORRFP  -0.1419 
TBCKDEFN  0.4015 
SONDNBS  -0.1018 
SOHCSSR  0.0548 
SONSDISP  0.1152 
SONRCNP  0.0559 
SONRCBP  0 . 1704 
SOWFRSI  -0.1435 
NOPMDZDS  0.2277 
NOBVCRZT  0.0482 
BVSDZSP  0.1153 
XVRCHP  -0.2303 
BWRCBP  -0.1054 

SBT  SCOMPLBX 
CGMPLXXl-0.1494 
C0MPIiXX2  0.0332 

SBT  STBCHDBF 
TBaiDBFl-0.2518 
TBCRDBF2  0.2302 
TBCHDBF3  0.2417 

SBT  SPLNBSU 
PLMBSL31-0.1398 
PLNBSL32  0.1442 
PLNBSL33 -0.0505 


0.8240 

1.41(1) 

0.8049 

0.31(1) 

0.0000 

0.00(0) 

0.0000 

0.00(0) 

0.5109 

0.13(0) 

0 . 8442 

0.83(1) 

0.4500 

1.41(1) 

0 . 1772 

0.24(1) 

0.4139 

0.30(0) 

0.5410 

0.44(1) 

0.7209 

3.27(0) 

0.3379 

0.18(1) 

0.5898 

0.05(1) 

0.4133 

0.23  (1) 

0.8244 

0.05(1) 

0.7435 

0.51(1) 

0.7147 

0.47(1) 

0.7448 

0.93(1) 

0 . 7140 

0.08(1) 

0.7012 

0.23(1) 

0.4741) 

0.95(1) 

0.7418 

0.19(1) 

F- 

0.30 

P-0. 

.74178(1) 

0.8823 

(1) 

0.7949 

(1) 

F- 

1.13 

P-0. 

.37003(1) 

0.4973 

(1) 

0.7997 

(1) 

0.4543 

(1) 

F- 

0.18 

P-0. 

.90559(1) 

0.4403 

(1) 

0.4789 

(1) 

0.7945 

(1) 

P-VALUBS<  0.100,  0.110)  OR  TOLBRANCB  INSUFFICIBNT  FC»l  FORTHBR  STBPPINQ 


H-8 


StMMMtY  TABLB 


STEP 

VARIABLE 

MDLTIPLE 

CHANtat 

P-VAUn 

P-VALOE 

NO. OP  VAR 

MO. 

ENTERED 

REMOVED 

R 

RSQ 

IN  RSQ 

ENTER 

REMOVE 

INCLUDED 

1 

SET 

SPLTRISK 

0.5557 

0.3088 

0.3088 

0.02 

2 

38 

PLTRISKl 

37 

PLTRISK2 

2 

9 

MOECPS 

0.7058 

0.4978 

0.1891 

0.01 

3 

3 

12 

PLCOHC 

0.7802 

0.5779 

0.0801 

0.07 

4 

4 

SET 

SPL8RI8X 

0.8235 

0.8782 

0.1003 

0.09 

8 

34  KiSRXSXl 

35  PLSRXSXa 


SERIAL  CORRBLATIOM  -O.XOlfi 

DDRBXN-HATSCRt  STATISTIC  2.1809  BASRD  ON  25  CASIS 


CASE 

PLOTS 

RESIDUALS 

LEVERAGE 

INFLUENCE 

CASE 

LABEL 

STRESID 

-LOG  P<H) 

MOOCOOK 

MO. 

-4 

-2 

0 

2 

4 

0 

1 

2 

3 

4 

0  1 

2  3  4 

5 

6 

. 

....... 

♦  .  .  • 

# 

♦  .  . 

.  .+ 

+  .  .+ 

+  . 

1 

## 

###* 

*#* 

2- 

M 

M 

M 

3 

##*# 

«# 

*♦* 

4- 

M 

M 

M 

5 
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.9  >  1 


♦ 


1 


.3 


-1 

1 

• 

- 

1 

- 

-1 

1  1 

1  1 

1 

- 

0.  *  1 

111  11 

11  1 

1  1 

1 

1* 

3. 

9. 

IS 

31 

0. 

6. 

12 

18 

24 

OCOSTCD 

5 

KXTRBII  CASKS  -< 

CASK  MO.  COOK 

CASB  NO.  OCOSTCD 

6  0.898S 

17 

25.7384 

34  0.6218 

35 

30.7504 

BXTRIMB  CASBS 

IM  THI  PLOTS  -- 

BXTRIMB 

CASB 

2 

9 

STATISTICS 

VALOB  MO. 

LABBL  NBIQHT 

SCHBDPBR 

NOBCPS 

COOK 

0.898S  6 

1.0000 

13. 

0000 

25.0000 

COOK 

0.6218  24 

1.0000 

334. 

0000 

35.0000 

CASE 

13 

34 

35 

36 

NO.  LABBL 

PLCONC 

PLSRISKl 

PLSRZSK2 

PLTRZSKl 

6 

0.0000 

1.0000 

0.0000 

1. 

0000 

24 

0.0000 

0.0000 

0.0000 

1. 

0000 

CASB 

37 

MO.  LABBL 

PLTRISK3 

« 

0.0000 

34 

0.0000 

LIST  or  rUBDICTBO  VALOIS,  RBSIOOALS,  AID  VARIABLSS 

-  CASKS  MITH  MZSSXm  VALOIS  All  NARKKD  MITR  A  MZlfOS  SIOH 
BITNIBt  TBI  CASK  HDMIIR  AMD  CASK  LABKL. 

-  ASTSRZSXS  (OP  TO  3)  TO  THI  RIGHT  OF  A  RISIOOAL  INDICATS  THAT 
THI  RISZOOAL  DIVIATIS  PROM  THI  NIAH  BY  MORI  THAN  THAT  mMBBR 
or  STAHDARD  OBVIATIONS. 

-  NISSIlia  VALOIS  AMD  VALOIS  OOT  OP  RAHGI  ARB  DIMOTBD  BY 

VALOIS  OUtATBR  THAN  OH  IQOAL  TO  2  ZM  ABSOLOTB  VALDB. 
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CkSS 

2  48 

49 

NO.  UUML 

puDicno 

RBSUXAl. 

NIZONT 

SCHBDPI8  NUSID 

ST8BSIO 

1 

120.8429 

-26.0429 

1.000 

94.8000  -26.0429 

-0.5851 

a- 

2.126S|4'37 

a.ia71+37+++  1.000  2 

.12688+37  2.12688+37  2 

.12688+37 

3 

40.2203 

-50.2203 

1.000 

-10.0000  -50.2203 

-1.0129 

4- 

2.12681+37 

a.l27t+37***  1.000  2 

.12688+37  2.12688+37  2 

.12688+37 

5 

79.7330 

52.1670 

1.000 

131.9000  52.1670 

1.0479 

6 

9S.3383 

-82.2383* 

1.000 

13.0000  -82.2383 

-2.2807 

7 

33.1629 

-19.7629 

1.000 

13.4000  -19.7629 

-0.4365 

• 

-10.8436 

35.0436 

1.000 

24.2000  35.0436 

0.8351 

9 

S9.S983 

-35.7983 

1.000 

23.8000  -35.7983 

-0.7887 

lo¬ 

2 . 12681+37 

2.1271+37***  1.000  2 

.12688+37  2.12688+37  2 

.12688+37 

ll 

83.7979 

-9.3979 

1.000 

74.4000  -9.3979 

-0.1967 

12 

80.S781 

36.1219 

1.000 

116.7000  36.1219 

0.7833 

13 

-36.4S92 

-1.4408 

1.000 

-27.9000  -1.4408 

-0.0313 

14 

-14.7948 

47.1948 

1.000 

32.4000  47.1948 

1.1247 

IS 

-4.7273 

34.7273 

1.000 

30.0000  34.7273 

0.7239 

16 

40.2203 

-4.9203 

1.000 

35.3000  -4.9203 

-0.0992 

17 

S0.09SS 

-20.5985 

1.000 

29.5000  -20.5985 

-0.4132 

IS¬ 

2.12681+37 

2.1271+37***  1.000  2 

.12688+37  2.12688+37  2 

.12688+37 

IS 

131.S914 

-12.2914 

1.000 

119.3000  -12.2914 

-0.2853 

20 

21.3091 

-5.3091 

1.000 

16.0000  -5.3091 

-0.1194 

21 

229.1399 

33.8601 

1.000 

263.0000  33.8601 

0.8756 

22 

-7.4344 

25.7344 

1.000 

18.3000  25.7344 

0.5835 

23 

61.9Sa3 

-15.1523 

1.000 

46.8000  -15.1523 

-0.3031 

24 

19S.3147 

138.6853** 

1.000 

334.0000  138.6853 

3.1147 

2S 

1S1.3477 

-11.6477 

1.000 

139.7000  -11.6477 

-0.2950 

26 

171.6071 

-90.3071* 

1.000 

81.3000  -90.3071 

-2.0389 

27 

79.7330 

-15.5330 

1.000 

64.2000  -15.5330 

-0.3120 

28 

87.7491 

-22.0491 

1.000 

65.7000  -22.0491 

-0.4631 

29 

30.224S 

19.1755 

1.000 

39.4000  19.1755 

0.4221 

CASK 

SO 

51 

52 

53  54 

55 

NO.  UUSBL 

0BLM8I0 

DSTKISIO 

API 

Q1  0 

KATDIAa 

1 

-37.7SS4 

-0.5741 

0.9810 

983.2856  0.3280 

0.3102 

2 

2.12681+37 

2.12681+37 

2.12688+37 

2.12688+37  2.12688+37 

2.12688+37 

3 

-S8.6773 

-1.0137 

0.9430 

2946.7939  1.2196 

0.1441 

4 

2.12681+37 

2.12681+37 

2 . 12688+37 

2.12688+37  2.12688+37 

2.12688+37 

S 

60.4626 

1.0510 

0.9390 

3154.1523  1.3160 

0.1372 

6 

-181.6709 

-2.6286 

0.7110 

14940.3145  3.2704 

0.5473 

7 

-27.6913 

-0.4265 

0.9894 

547.2610  0.1889 

0.2863 

8 

S7.1S94 

0.8278 

0.9613 

2003.0673  0.5938 

0.3869 

9 

-49.9126 

-0.7801 

0.9654 

1786.7860  0.6197 

0.2828 

10 

2.12688+37 

2.12681+37 

2 . 12688+37 

2.12688+37  2.12688+37 

2.12688+37 

11 

-11.8282 

-0.1914 

0.9978 

111.1596  0.0427 

0.2055 

12 

48.7869 

0.7745 

0.9659 

1762.2755  0.6310 

0.2596 

13 

-1.9S89 

-0.0305 

0.9999 

2.8224  0.0010 

0.2645 

14 

76.9839 

1.1336 

0.9297 

3633.2412  1.0771 

0.3870 

IS 

43.3368 

0.7139 

0.9709 

1504.9689  0.5832 

0.1987 

16 

-S.7489 

-0.0965 

0 . 9995 

28.2863  0.0117 

0.1441 

17 

-23.8044 

-0.4035 

0.9905 

490.3345  0.2052 

0.1347 

18 

2.12681+37 

2.12681+37 

2 . 12688+37 

2.12688+37  2.12688+37 

2.12688+37 

19 

-19.0164 

-0.2779 

0.9955 

233.7377  0.0731 

0.3536 

20 

-7.7113 

-0.1161 

0.9992 

40.9401  0.0136 

0.3115 

21 

65.0378 

0.8697 

0.9574 

2202.1860  0.5544 

0.4794 

22 

37.9994 

0.5725 

0.9811 

977.8911  0.3202 

0.3228 

23 

-17.4190 

-0.2954 

0.9949 

263.9377  0.1110 

0.1301 

24 

200.9108 

4.4578**  0.4611 

27863.3828  9.3007 

0.3097 

2S 

-21.4663 

-0.2874 

0.9952 

250.0338  0.0656 

0.4574 

26 

-132.2099 

-2.2594 

0.7691 

11939.4844  3.9436 

0.3169 

27 

-18.0030 

-0.3041 

0.9946 

279.6400  0.1167 

0.1372 

28 

-27.9378 

-0.4528 

0.9881 

616.0039  0.2351 

0.2108 

29 

26.6931 

0.4123 

0.9901 

511.8537  0.1778 

0.2816 
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OkSt 

S6 

57 

58 

59 

60 

61 

NO.  LABCL 

waa 

AP2 

NAMAL 

COOK 

HOOCOOK 

DFFITS 

1 

0.4498 

0.6898 

6.4857 

0.0220 

0.6174 

-0.3850 

2 

2.1268l>37 

2.12681437 

2.12681437 

2.12681437 

2.12681437 

2.126814'37 

3 

0.1684 

0.8559 

2.4991 

0.0247 

0.6670 

-0.4160 

4 

2.1268l'«'37 

2.12681437 

2 . 12681437 

2.12681437 

2.12681437 

2.1268B'»37 

5 

0.1S90 

0.8628 

2.3328 

0.0249 

0.6721 

0.4191 

6 

1.2091 

0.4527 

12.1757 

0.8985 

4.6349 

-2.8903 

7 

0.4012 

0.7137 

5.9115 

0.0109 

0.4332 

-0.2701 

• 

0.6311 

0.6131 

8.3260 

0.0629 

1 . 0545 

0.6576 

9 

0.3943 

0.7172 

5.8267 

0.0350 

0.7855 

-0.4898 

10 

2 . 12681437 

2.12681437 

2 . 12681437 

2.12681437 

2.12681437 

2.126814-37 

11 

0.2S86 

0.7945 

3.9712 

0.0014 

0.1561 

-0.0973 

12 

0.3S06 

0.7404 

5.2704 

0.0307 

0.7355 

0.4586 

13 

0.3S96 

0.7355 

5.3883 

0.0001 

0.0293 

-0.0183 

14 

0.6312 

0.6130 

8.3269 

0.1141 

1.4442 

0 . 9006 

IS 

0.2479 

0.8013 

3.8080 

0.0186 

0.5700 

0.3555 

16 

0.1684 

0.8559 

2.4991 

0.0002 

0.0635 

-0.0396 

17 

0.1SS6 

0.8653 

2.2723 

0.0038 

0.2552 

-0.1592 

10 

2.12681437 

2.12681437 

2.12681437 

2.12681437 

2.12681437 

2.1268107 

19 

0.S471 

0.6464 

7.5274 

0.0064 

0.3296 

-0.2055 

20 

0.4S2S 

0.6885 

6.5164 

0.0009 

0.1252 

-0.0781 

21 

0.9208 

0.5206 

10.5451 

0.1009 

1.3382 

0.8345 

22 

0.4766 

0.6772 

6.7865 

0.0232 

0.6338 

0.3952 

23 

0.1496 

0.8699 

2.1631 

0.0020 

0.1832 

-0.1142 

24 

0.4487 

0.6903 

6.4732 

0.6218 

4.7883 

2.9860 

2S 

0.8430 

0.5426 

10.0175 

0.0105 

0.4232 

-0.2639 

26 

0.4640 

0.6831 

6.6466 

0.2755 

2.4680 

-1.5391 

27 

0.1S90 

0.8628 

2.3328 

0.0022 

0.1944 

-0.1213 

28 

0.2671 

0.7892 

4.0987 

0.0082 

0.3752 

-0.2340 

29 

0.3920 

0.7184 

5.7991 

0.0100 

0.4140 

0.2582 

CASI 

62 

63 

64 

65 

66 

MO.  ZABCL 

AP 

STUBS**! 

AP2*PIUED 

XRBS2D0L 

ymsiooi. 

1 

0.6766 

0.3423 

83.3528 

-0.4933 

-31.2764 

2 

2.12681437 

2.1268B437 

2.12681437 

2.12681437 

-31.2764 

3 

0.8071 

1.0260 

34.4234 

0.0914 

-49.2510 

4 

2.12681437 

2.12681437 

2 . 12681437 

2.12681437 

-49.2510 

S 

0.8102 

1.0982 

68.7935 

0.1051 

53.2821 

6 

0.3219 

5.2017 

43.1122 

0.1194 

-80.9717 

7 

0.7061 

0.1905 

23.6679 

0.6142 

-13.2467 

8 

0.S893 

0.6974 

-6.6480 

-0.0590 

34.4175 

9 

0.6924 

0.6221 

42.7450 

-0.5146 

-41.2576 

10 

2.1268B437 

2.1268B437 

2.12681437 

2.12681437 

-41.2576 

11 

0.7928 

0.0387 

66.5801 

-0.3645 

-13.2654 

12 

0 . 71S2 

0.6136 

59.6602 

0.6307 

42.8130 

13 

0 . 7354 

0.0010 

-19.4604 

0.2098 

0.7852 

14 

0.5700 

1.2650 

-9.0699 

-0.0604 

46.5542 

IS 

0.7780 

0.5240 

-3.7881 

0 . 2174 

37.0334 

16 

0.8SS4 

0.0098 

34.4234 

0.0914 

-3.9510 

17 

0.8S71 

0.1707 

43.3513 

0.0948 

-19.5927 

18 

2.12681437 

2.12681437 

2.12681437 

2.12681437 

-19.5927 

19 

0.6434 

0.0814 

85.0553 

0.2647 

-9.4825 

20 

0.6879 

0.0143 

14.6710 

0.6101 

1.1634 

21 

0.4984 

0.7667 

119.2951 

0.5406 

39.5955 

22 

0.6644 

0.3405 

-5.0348 

-0.7799 

17.4600 

23 

0.8654 

0.0919 

53.8904 

0.0989 

-14.1028 

24 

0.3183 

9.7011 

134.8224 

-0.3259 

135.2280 

2S 

0.S400 

0.0871 

82.1221 

0.2716 

-8.7660 

26 

0.S253 

4.1569 

117.2177 

-0.3341 

-93.8518 

27 

0.8S81 

0.0974 

68.7935 

0.1051 

-14.4179 

28 

0.7798 

0.2145 

69.2536 

-0.3632 

-25.9021 

29 

0.7113 

0.1782 

14.5287 

-0.7703 

11.0031 

R 

R 

S 

X 

0 

o 

A 
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R 

B 

S 

I 
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ISO 

♦ 

....... 

....... 

....... 

....... 

....... 

...... 

♦ 

- 

1 

100 

♦ 

<*• 

• 

• 

50. 

•f 

1 

1 

♦ 

- 

1 

1 

- 

- 

11 

1  - 

- 

1 

- 

0.0 

>1 

1 

<«• 

- 

1 

1 

1 

1 

- 

- 

1 

1  1 

11 

- 

- 

1 

- 

- 

1 

- 

-SO. 

1 

4> 

- 

1 

- 

1 

- 

-100 

-f 

•f 

........ 

30. 

90. 

150 

210 

0.0 

60. 

120 

180 

PRRSICTD 

20000 

♦ 

•f 

- 

1 

- 

ISOOO 

♦ 

•f 

10000 

♦ 

- 

1 

- 

- 

1 

- 

SOOO. 

♦ 

-f 

• 

1 

1 

1 

• 

- 

1 

1 

- 

- 

111 

1 

1 

1 

1  - 

0.000 

*1 

2  11 

1 

11 

1 

1 

...... 

30. 

90. 

150 

210 

0.0 

60. 

120 

180 

PRBDXCTD 
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OK  O  M  H  n  M  >0  K  M  X  O  »  •«  K  O  H  H  >•  M  <  H  O 


DITRIMDID  MORMM.  PKOMBILITY  PLOT  OP  OMMliairSD  KSSUXIALS 


-CO. 

........... 

-20. 

....... . 

20. 

CO. 

100  140 

'80. 

1 

o 

0.0 

40. 

SO. 

120 

VALUBS  PROM  HCMOUL  DISTRIBUTIOM  HOOLD  LIB 
OH  TRB  LZBB  IMDXCXTBD  BT  THB  SYMBOL  - 


BHD  OP  mSTROCriOIIS 
PROCnUM  TBRMZHATBD 


f 
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N6  Intaraction  Terms  (Edited  Data 


PROORAM  nSTROCTIOHS 


/mVOT  PILR-'THISIS.ASC' . 

VRRZABLIS-33 . 

FcnaT-nn. 

4  /VRRXABU  MMtlS-CMO.  SCHIDPIR.  SCHIBNOO,  SCHIDPLR,  OCOSTCD, 

crypi,  0  DP,  PROOOPT,  moicps,  pi,pr>sch.  plaoor,  plcchc, 

PL8RZSX.~PLTRZ8X.  COMPLIX.  PAOISSOM.  MOOXDS,  PLNBSOIV, 
PLNBSL3,  PUIMLL,  PUMRPP,  TICHDIIM,  SOMDNBS,  SONCSSR, 
S0W80ISP,  SOMRCNP,  SOMRCBP.  SONPRSZ,  MOPMDXDS,  MOSVCRZT, 
RVSOZSP,  IVRCNP,  IVRCIP. 


OSI-SCHICHCX).  OCX>STCD,  CDTPR,  0_DP.  PRCOOPT,  NORCPS, 
PLPRISCH,  PLJUJOR.  PLCCMC,  PLSRZix,  PLTRZSK,  COMPLEX, 
PM3ISSON,  HOOZOS,  PLNBSOIV,  PLHBSL3,  PUatRFP,  TBCMDIPM, 
SONDMBS,  SONCSSR,  SONSOZSP,  SONRCHP.  SONRCBP,  SONPRSZ, 
HOPMDZDS,  HOIVCRZT,  IVSDZSP,  IVRCNP,  IVRCBP,  PLSRZSXl, 
PLSRZSIC2,  PLIKZSICl,  PLT1USX2,  COMPLBCl,  CCMPLIX2,  TBCHDIPl, 
TICBDIP2,  TICHDIP3,  PLNBSL3Z,  PUIBSL32,  PLNBSL33. 


/TRANSPORN  ZP (PLSRZSK 

IQ 

1) 

ZP (PLSRZSK 

IQ 

3) 

ZP (PLSRZSK 

IQ 

3) 

ZP (PLTRZSK 

IQ 

1) 

ZP (PLTRZSK 

IQ 

2) 

ZP (PLTRZSK 

■Q 

3) 

ZP (COMPLBX 

IQ 

1) 

ZP (COMPLEX 

BQ 

2) 

ZP (COMPLEX 

IQ 

3) 

THBKPLSRZSKl-O. 

THBKPLSRZSKl-l. 

THBKPLSRZSKl-O. 

THBKPLTRZSn-O. 
TRBKPLTRZSKl-l. 
THIN(PLTRZSIC1>0 . 

THIN(CaHPLIXl-0. 

THIN(C0NPLIX1-1. 

THIN(CCIMPLIXl-0. 


PLSRZSX3-0.)  . 
PLSRZS1C2-0.)  . 
PLSRZSK2-1.) . 

PLT11ZSIC3-0.)  . 
PLTRZSIQ-0.)  . 
PLTRZSX3-X.) . 

COMPLIXa.O.)  . 
COMPLBX3-0 . ) . 
C0MPLXX2-1.)  . 


ZPdVCHDini  IQ  1)  THIN(TICRDIFl-0.  TBCBDIF2>0.  TICHDIF3-0 . ) . 
ZP(TBaiDIPM  IQ  3)  TBBKTBCHDIPl-l.  TICHDIP2-0.  TBCHOIF3-0 . ) . 
ZFCTICHOIFN  IQ  3)  THIH(TBCHDIFX-0 .  TICHDIF3-1.  TICHDIF3-0 . ) . 
ZP(TBCHDBFM  IQ  4)  THIM(TBCI1DIF1«0 .  TBCHDBF3-0.  TICHDIF3>1 . )  . 


ZF(PLNBSL3  EQ  0)  THIN(PLNBSL31>0.  PLWBSL33>0.  PLWBSL33-0 . ) . 

ZF(PLNBSL3  CT  0  AND  PLNBSL3  LB  10)  THIN (PLNBSL3 1-1.  PLWBSL32-0.  PLWBSL33-0 . ) . 
ZF(PLNBSL3  6T  10  AND  PLNBSL3  LB  16)  THIN (PLNBSL3 1-0 .  PLWBSL32-1.  PLWBSL33-0 . ) . 
ZF(PLNBSL3  GT  16)  THBN(PLNBSL31-0 .  PLNBSL32-0.  PLNBSL33-1. ) . 


/ORODP  CODES (D  DP,  PR(»OPT,  PLPRISCH,  PLNBSDBV,  PLDRRFP,  SOWDNBS, 
SONSDZSP,  SOHRCNP,  IVSDZSP,  CTYPB,  PLAOCHl,  PLCOIC,  SONCSSR, 
SONRCBP,  SONPRSZ,  EVr.CNP,  IVRCBP,  PLSRZSKl,  P1,SRZS1Q, 
PLTRZSKl,  PLTRZSKS,  OMPLIXl,  C0MPLXX2,  PLHBSL31,  PLNBSL32, 
PLHBSU3,  TBCHDIPl,  TBCHDBP3,  TBCHDIP3)-1,0. 


NANIS (D  OP,  PROOOPT,  PLPRISCH,  PLNBSDBV,  PLDRRFP,  SONDNBS, 
SONSOZSP,  SONRCNP,  BVSDZSP,  CTYPB,  PLAGOR,  PLCONC,  SONCSSR, 
SONRCBP,  SONPRSZ,  BVRCNP,  BWCBP,  PLSRZSKl,  PLSRZSK2, 
PLTRZSKl,  PLTRZSK2,  COMPLBXl,  C0HPLBX2,  PLNBSL31,  PLNBSL32, 
PLNBSL33,  TBCHDIPl,  TBCHDBF2,  TBCHDBF3 ) -YBS ,  NO. 

CODES (PLSRZSK,  PLTRZSK,  COMPLEX)-!,  2,  3. 

NANIS (PLSRZSK,  PLTRZSK) -LON,  LON  NBD,  OTHER. 

NANIS (COMPLBX) -LON,  HID,  HZ. 


CODES (TBCHDBPN)-l,  2,  3,  4. 

NANIS (TICHDBFN) -ORAPT_A,  FDLL_A,  DRAFTED,  FOLL_B. 
NANIS (PLNBSL3) -'aNDBR_3' ,  '2_11',  '11_17',  'OVBR_17' . 


I-l 


/itnuss 


OI»BID.S<aSDNCO. 

SMXIOHBSmaPLaUSX,  SfLTJUSX,  SCOUPtMX,  SnCHDMT,  SPUIBSL3. 
sptausKmnMXSKi.  PLSusn. 

Sn.T1U8IC«PLTIlXSia,  PLTUSlCa. 

SCOIIPLlX«CaMK.>Xl,  CONPLXXS. 

STBOlDBr-TICHDBri,  TSCHDETS,  nCHDITB. 

S»Ui>SI.3«VUIB8L31,  PLMB81.32.  PUIBSL33 . 

unpv»L-o.i,  0.1. 
o(jrpv»L-o.ii,  0.11. 

XMDgFIND-Cnm,  PXMCBl.  PLCOHC.  PJIOISSOH.  HODIDS,  PLHtRTP, 
SONCSSR.  SONRCBP.  SOMfUZ,  MOMOZOS.  tniVCKZT,  CVHCNP,  IVRCBP, 
OCOSTCD.  0  OP.  PROOOPT,  MOICPS.  PLP81SCR,  PLNBSDIV,  SONDMBS, 
S0N80Z8P,  iOMRCNP.  IVSDZSP.  SPLSRZSX.  SPLTRZSX,  SCOMPLXX, 
SnCHDIP,  SPLHBSU. 

TOZi-O.l. 


/pRzirr  Lxvit..4ainmL. 

MO  DMA. 

MO  COMtXLATZOH. 

STIP. 

ANOVA. 

MO  COVX. 

MO  PART. 

MO  cosrr. 

MO  PRATZO. 

MO  RRIQ. 

CASB.0. 

OZASNOSTZCS-Z>STRRSZO,  KATOZAO,  COOK. 
LZMBSZZI-80 . 


/PLOT  RISZOaALS. 

mORMAL. 

SZZH-C0.3S. 

CASBPLOTS. 

STSP-ALL. 

XVAR-DCOSTCD. 

YVAR-COOK. 

NO  DATA. 

/BND 


NOMBBR  OF  CASKS  RBAO .  29 

CASBS  NZTH  DATA  MZSSZHG  OR  BBTOMD  LZMZTS  .  .  6 

RBMAZHZM8  HOKBBR  OF  CASBS .  23 


1-2 


DISaUPTIVI  STATISTICS  OF  DATA 


VARZABLI  TOTAL 

STANDARD 

SKIN- 

SMALLBST 

LARSBST 

MO. 

KAMI 

FRIQ. 

MRAH 

DIV. 

MISS  KDRTOSIS 

VALOB  Z-SCR 

VALOB 

Z-SCR 

3 

schumoo 

23 

S0.96S 

45.414 

0.460 

-0.842 

-27.900  -1.74 

139.70 

1.95 

5 

OCOSTCD 

23 

'9.7290 

7.1877 

0.473 

-0.864 

.18103  -1.33 

25.738 

2.23 

6 

crypB 

23 

.39130 

.49901 

0.417 

-1.904 

0.0000  '0.78 

1.0000 

1.22 

7 

D  OP 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

• 

PROOOPT 

23 

.56522 

.50687 

-0.246 

-2.022 

0.0000  -1.12 

1.0000 

0.86 

9 

NOICPS 

23 

28.696 

23.688 

1.437 

1.311 

5.0000  -1.00 

95.000 

2.80 

10 

PLPRBSCH 

23 

. 82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

11 

PLAOR 

23 

.21739 

.42174 

1.282 

-0.367 

0.0000  -0.52 

1.0000 

1.86 

12 

PLCOHC 

23 

.43478 

.50687 

0.246 

-2.022 

0.0000  -0.86 

1.0000 

1.12 

13 

PZ.SRZ8K 

23 

2.2609 

.91539 

-0.501 

-1.663 

1.0000  -1.38 

3.0000 

0.81 

14 

PLTRZSK 

23 

2.1304 

.96786 

-0.245 

-1.932 

1.0000  -1.17 

3.0000 

0.90 

IS 

COMPUDC 

23 

2.0435 

.70571 

-0.053 

-1.080 

1.0000  -1.48 

3.0000 

1.36 

1« 

PAOBSSON 

23 

40.783 

17.789 

0.885 

-0.004 

17.000  -1.34 

87.000 

2.60 

17 

NODIOS 

23 

61.478 

20.956 

-0.048 

-1.028 

25.000  -1.74 

100.00 

1.84 

18 

PLNBSDIV 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

19 

PLNBSL3 

23 

13.957 

16.291 

1.992 

3.866 

0.0000  -0.86 

70.000 

3.44 

21 

PLDRRPP 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

22 

TICRDBFH 

23 

2.6522 

1.1912 

-0.115 

-1.601 

1.0000  -1.39 

4.0000 

1.13 

23 

SONDNBS 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

24 

SONCSSR 

23 

.43478 

.50687 

0.246 

'2.022 

0.0000  -0.86 

1.0000 

1.12 

2S 

SONSDISP 

23 

.78261 

.42174 

-1.282 

-0.367 

0.0000  -1.86 

1.0000 

0.52 

26 

SOMICMP 

23 

.78261 

.42174 

-1.282 

-0.367 

0.0000  -1.86 

1.0000 

0.52 

27 

SONRCBP 

23 

.65217 

.48698 

-0.598 

-1.711 

0.0000  '1.34 

1.0000 

0.71 

28 

SOMPRSZ 

23 

.86957 

.34435 

-2.053 

2.322 

0.0000  -2.53 

1.0000 

0.38 

29 

MOPMDZDS 

23 

7.4783 

2.3716 

-0.003 

'0.845 

3.0000  -1.89 

12.000 

1.91 

30 

MOBVCRIT 

23 

4.0000 

2.5226 

1.398 

1.273 

1.0000  -1.19 

11.000 

2.77 

31 

BVSDZSP 

23 

.56522 

.50687 

-0.246 

'2.022 

0.0000  -1.12 

1.0000 

0.86 

32 

BVRCNP 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

33 

BVRCBP 

23 

.65217 

.48698 

-0.598 

-1.711 

0.0000  -1.34 

.1.0000 

0.71 

34 

PLSRZSKl 

23 

.13043 

.34435 

2.053 

2.322 

0.0000  -0.38 

1.0000 

2.53 

3S 

PLSRISX2 

23 

.56522 

.50687 

-0.246 

-2.022 

0.0000  -1.12 

1.0000 

0.86 

36 

PLTRZSXl 

23 

.08696 

.28810 

2.743 

5.779 

0.0000  -0.30 

1.0000 

3.17 

37 

PLTRZSX2 

23 

.52174 

.51075 

-0.081 

-2.078 

0.0000  -1.02 

1.0000 

0.94 

38 

CCMPLBXl 

23 

.52174 

.51075 

-0.081 

-2.078 

0.0000  -1.02 

1.0000 

0.94 

39 

CQMPLIX2 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

40 

TBCHDBPl 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

41 

TBCHOBP2 

23 

.17391 

.38755 

1.610 

0.624 

0.0000  -0.45 

1.0000 

2.13 

42 

TBCHDBP3 

23 

.34783 

.48698 

0.598 

-1.711 

0  0000  -0.71 

1.0000 

1.34 

43 

PLNBSUl 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

44 

PLNBSL32 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

45 

PLMBSL33 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

•••hots  •••  KORTOSIS  VALOIS  QKIATIR  THAN  ZERO  ZMDICATB  A  DISTRZBOTION  WITH 
HIAVZBR  TAILS  TRAM  NORMAL  DISIRZBOTZON . 


STtP  NO. 


0 


STD.  BtROR  OF  BST.  45.4135 
ANALYSIS  OF  VARIANCB 
RRSIDOAL 
VARIABLIS  IN  SQaRTZOH 


SQM  OF  SQQARBS 
45373.512 


DF  MEAN  SQOARR 
22  20C2.387 

VARIABLIS  MOT  IN  BQOATION 


STD.IRR  F  AND  P  PARTIAL  F  AMD  P 

VARIABLE  COBFF.  OF  COEFF  TOL.  RBMOVI(L)  VARIABLE  CORR.  TOL.  BMTBR(L) 


(CONSTANT  S0.9C52) 


OCOSTCD  0.3910 

1.0000 

3.79(1) 

CTYPI  -0.1434 

1.0000 

0.44(1) 

D  DP  '0.09C3 

1.0000 

0.20(1) 

mODOPT  0 . 114S 

1.0000 

0.28(1) 

NOBCPS  0 . 7793 

1.0000 

32.48(1) 

PLPRESCH-0.4464 

1.0000 

5.23(1) 

PIAOOR  0 . 0699 

1.0000 

0.10(1) 

PLCONC  -0.0726 

1.0000 

0.11(1) 

PLSRISX  0.0015 

1.0000 

0.00(0) 

PLTRISX  0.0033 

1.0000 

0.00(0) 

COMPLEX  0.3813 

1.0000 

3.57(0) 

PAGESSOH  0.1534 

1.0000 

0.51(1) 

NODIDS  -0.0515 

1.0000 

0.06(1) 

PLHBSOEV  0.2070 

1.0000 

0.94 (1) 

PLNBSL3  0.0694 

1.0000 

0.10(0) 

PLDRRFP  -0.2801 

1.0000 

1.79(1) 

TECHDBFN-O . 0400 

1.0000 

0.03 (0) 

SOHDHBS  0.1732 

1.0000 

0.65(1) 

SOWCSSR  -0.0114 

1.0000 

0.00(1) 

S0WSDI5P- 0.0559 

1.0000 

0.07(1) 

SOHRCMP  -0.1112 

1.0000 

0.26(1) 

SONRCBP  -0.1317 

1.0000 

0.37(1) 

SONFRSI  0.0878 

1.0000 

0.16(1) 

NOFMDIDS  0.2471 

1.0000 

1.37(1) 

NOBVCRIT-0.0548 

1.0000 

0.06(1) 

EVSDISP  0.2785 

1.0000 

1.77(1) 

EVRCNP  0.2021 

1.0000 

0.89(1) 

BVRCBP  0.1497 

1.0000 

0.48(1) 

F- 

0.63 

SET  SPLSRISX 

P-0. 

.54269(1) 

PLSRlSXl-0.2421 

1.0000 

(1) 

PLSRISX2  0.0836 

1.0000 

(1) 

F- 

0.01 

SET  SPLTRISX 

P«0. 

.99298(1) 

PLTRISXl- 0.0365 

1.0000 

(1) 

PLTRISX3  0.0096 

1.0000 

(1) 

F- 

1.75 

SET  SCX3MPLBX 

PmO. 

.19921(1) 

COfPLBXl  0.0349 

1.0000 

(1) 

CaMPLSX2  0.3798 

1.0000 

(1) 

F- 

0.37 

SET  STBCHOEF 

P>0. 

.77325(1) 

TBC8DBF1  0.2189 

1.0000 

(1) 

TECIIDIF2-0.1355 

1.0000 

(1) 

TBCBDBF3-0.0280 

1.0000 

(1) 

F- 

2.16 

SET  SPLNBSL3 

P>0 

.12686(1) 

PLHBSL31  0.4951 

1.0000 

(1) 

PLNBSL33-0.1574 

1.0000 

(1) 

PLNBSL33-0.1123 

1.0000 

(1) 

* 


1-4 


STBP  HO. 


1 


VMUABLB  BMTailD  9  NOBCPS 


» 


MOLTIPLB  R 
MDLTIPbB  R-SQOARB 
adjusted  R-SQOARB 


0.7793 

0.6073 

0.5886 


STD.  IRROR  OF  BST. 


39.1276 


4 


Aim.YSlS  OP  VMRZANCB 


StBt  OF  SQOARBS 

DF 

MEAN  SQDARE 

F  RATIO 

RBQRBSSION 

27555.753 

1 

37555.75 

32.48 

RESIDOAL 

17816.763 

31 

848.4172 

VARIABLES  IN  BQOATiaN 


VARIABLES  NOT  IN  BOOATIOH 


VARIABLE 

COBFF. 

STD. ERR 

OF  COBFF  TOL. 

F  AND  P 
REMOVE (L) 

PARTIAL 

VARIABLE  CORR.  TOL. 

F  AMD  P 
ENTER (L) 

(CONSTANT 

8.0927) 

NOBCPS 

1.4940 

0.3632  1.0000 

32.48(1) 

UCOSTCD  0.1434 

0.8434 

0.42(1) 

CTYPB  0.1577 

0.9071 

0.51(1) 

D  DP  -0.0732 

0.9958 

0.11(1) 

PRODOPT  0.2974 

0.9917 

1.94(1) 

PLPRBSOI- 0.7172 

1.0000 

21.18(1) 

PLAG6R  -0.1911 

0.9429 

0.76(1) 

PLCONC  0.4541 

0.8204 

5.20(1) 

PLSRISK  0.0473 

0.9987 

0.04 (0) 

PLTRISK  -0.0455 

0.9984 

0.04 (0) 

COMPLEX  0.1589 

0.8626 

0.52(0) 

PAGBSSOH  0.2181 

0.9995 

1.00(1) 

NODIDS  0.2806 

0.9202 

1.71(1) 

PLHBSDBV  0.1302 

0.9737 

0.35(1) 

PLHBSL3  0.0081 

0.9932 

0.00(0) 

PLDRRFP  -0.0285 

0.8859 

0.02(1) 

TECHDEFN  0.2843 

0.9264 

1.76(0) 

SOWDWBS  0.0693 

0.9720 

0.10(1) 

SOWCSSR  0.2917 

0.9414 

1.86(1) 

SONSDISP- 0.0298 

0.9977 

0.02 (1) 

SOHRCWP  0.0180 

0.9753 

0.01(1) 

SOHRC3P  -0.1104 

0.9935 

0.25(1) 

SOWFRSI  0.1464 

1.0000 

0.44 (1) 

NOPMDIDS  0.5661 

0.9820 

9.43 (1) 

NOEVCRIT  0.1805 

0.9550 

0.67(1) 

EVSDISP  -0.0028 

0.8708 

0.00(1) 

EVRCHP  0.4111 

0.9950 

4.07(1) 

BVRCSP  0.3959 

0.9847 

3.72(1) 

F- 

0.18 

SET  SPLSRISK 

P>0 

.83783 (1) 

PLSRISKl-0.1322 

0.9573 

(1) 

PLSRISK2  0.0866 

0.9986 

(1) 

F« 

0.03 

SET  SPLTRISK 

P-0 

.96992(1) 

PLTRISKl  0.0356 

0.9961 

(1) 

PLTRISK2-0.0532 

0.9970 

(1) 

Fa 

0.25 

SET  SCOMPLEX 

P-0 

.78141(1) 

COMPLEXl  0.0060 

0.9984 

(1) 

C0MPLEX2  0.1169 

0.9279 

(1) 

F- 

1.34 

SET  STBCHDBF 

P-0 

.29357(1) 

TECKDBFl- 0.0913 

0.8777 

(1) 

ijCHDBF2- 0.2546 

0.9991 

(1) 

TBCHDBF3  0.4096 

0.8810 

(1) 

F- 

0.45 

SET  SPLHBSL3 

P-0 

.71825(1) 

PLNBSL31  0.2553 

0.7954 

(1) 

PLWBSL32-0.0274 

0.9675 

(1)  • 

PLWBSL33 -0.0829 

0.9940 

(1) 

1-5 


STSP  NO. 


2 


VMtXABLI  SHmUm  10  PLPRXSCSl 


Nai.TIPLB  R  0 . 8996 
MDLTXPLB  R-SQORRB  0.8093 
ADjnSTBD  R-SQORRB  0.7903 

STO.  IRROR  OP  BST.  20.8006 


AHRLYSIS  OP  VRRZANCB 

SOM  OP  SQOARRS 
RB8RBSSI0N  36719.346 
RRSIDORL  8653.3676 


DP  MEAN  SQOARI 
3  18359.62 

20  432.6634 


P  RATIO 
43.43 


VARZABLIS  IN  RQOATiaii 


VARZARLSS  NOT  IN  KQOATZCH 


m 


VARIABLB 


(CONSTANT 

NOBCPS 

PLPRRSCH 


STO.IRR  P  AND  P 

COSPP.  OP  COBPP  TOL.  RSHOVR(L) 


51.4996) 

1.4974  0.1873  1.0000  63.97(1) 

-52.6612  11.4429  1.0000  21.18(1) 


PARTIAL  P  AND  P 


VARIABLE  CatOL. 

TOL. 

ENTER (L) 

OCOSTCD  0.1037 

0.8350 

0.21(1) 

CTYPB  0.3749 

0.8891 

3.11(1) 

D  DP  -0.0930 

0.9957 

0.17(1) 

PRODOPT  0.2541 

0.9626 

1.31(1) 

PLAGOt  -0.0195 

0.8849 

0.01(1) 

PLCONC  0.5861 

0.8169 

9.94 (1) 

PLSRZSK  -0.0587 

0.9837 

0.07(0) 

PLTRISK  -0.1253 

0.9951 

0.30(0) 

COMPLEX  0.0751 

0.8434 

0.11(0) 

PAOESSOH  0.3935 

0.9993 

1.79(1) 

NODIDS  0.4335 

0.9194 

4.40(1) 

PLWBSDEV  0.2835 

0.9653 

1.66(1) 

PLNBSL3  0.0398 

0.9934 

0.03 (0) 

PUNIRPP  -0.2766 

0.8421 

1.57(1) 

TECRDBPN  0.5865 

0.9010 

9.96(0) 

SONDNBS  0.1958 

0.9637 

0.76(1) 

SOHCSSR  0.3561 

0.9378 

2.76(1) 

SONSDISP-0.0052 

0.9964 

0.00(1) 

SONRCNP  -0.2325 

0.9171 

1.09(1) 

SOHRCBP  -0.0068 

0.9719 

0.00(1) 

SOWPRSI  0.0276 

0.9684 

0.01(1) 

HOPMDIDS  0.4344 

0.8225 

4.42(1) 

NOBVCRIT  0.1637 

0.9465 

0.52(1) 

EVSDISP  0.0612 

0.8673 

0.07(1) 

BVRCHP  0.3816 

0.9508 

3.24(1) 

EVRCBP  0.3349 

0.8727 

1.11(1) 

P> 

0.03 

SET  SPLSRZSK 

P>0. 

.96886(1) 

PLSRISKl- 0.0020 

0.9254 

(1) 

PLSRISK2-0.0527 

C.9693 

(1) 

P> 

0.70 

SET  SPLTRZSX 

P-0. 

.50768(1) 

PLTRISX1-0.230B 

0.9257 

(1) 

PLTRISK2-0.0559 

0.9966 

(1) 

P- 

0.82 

SET  SCOMPLEX 

P-0. 

.45786(1) 

COMPLBXl  0.2741 

0.9362 

(1) 

C0MPLBX3-0.1039 

0.8649 

(1) 

F- 

6.24 

SET  STECRDBP 

P-0 

.00472(1) 

TECHDBPl- 0.4224 

0.8146 

(1) 

TECHDBP3- 0.1531 

0.9548 

(1) 

TECHDEP3  0.6961 

0.8718 

(1) 

F- 

0.59 

SET  SPLHBSL3 

P-0 

.62746(1) 

PLHBSL31  0.0792 

0.7321 

(1) 

PLMBSL32  0.3567 

0.8928 

(1) 

PLNBSL33-0.1070 

0.9938 

(1) 

* 


Ar 


1-6 


STSP  MO. 


3 


VMIIABLI  BNTBRID  SST  STBCaiDIF 

40  TtCHDIPl 

41  ncHDsn 

'o  42  TBCHDBP3 

MOLTIPUt  R  0.9535 

NOLTIPUI  R-SQORRC  0.9092 

ADJOSTID  R-SQOMRB  0 . S825 

^  STD.  SRROR  OP  1ST.  15.5654 

ANALYSIS  OP  VARIANCI 

StM  OP  SQOARBS  OP  MIAH  SQOARB  P  RATIO 

RBOtBSSION  41253.711  5  8250.742  34.05 

RESIDUAL  4118.8022  17  242.2825 

VARIABLES  IM  EQUATION  VARIABLES  NOT  IN  EQUATION 

STD. ERR  P  AND  P  PARTIAL  P  AMD  P 

VARIABLE  COBPP.  OP  CX3BPP  TOL.  REMOVB(L)  VARIABLE  CORR.  TOL.  ENTER (L) 

(CONSTANT  41.6281) 

MOBCPS  1.7583  0.1544  0.8234  129.70(1)  UCOSTCD  -0.0839  0.5929  0.11(1) 

PLPRBSCH  -59.2192  9.0166  0.9019  43.14(1)  CTYPB  0.2266  0.6820  0.8’’(1) 

P-  6.24 

SET  STBCHDBP  P>0. 00472(1) 

TBCHDBPl  -9.2498  9.7610.5734  (1)  D_DP  0 . 2454  0 . 7067 (0 . 326) (1) 

TBCHDBP2  2.2527  10.5950  0.6532  (1) 

TBCHDBP3  28.2415  9.0678  0.5648  (1) 

PRODOPT  0.0182  0.8286  0.01(1) 

PLAG6R  0.13310.8556  0.29(1) 

PLCONC  0.4746  0.6407  4.65(1) 

PLSRISK  -0.2462  0.8748  1.03(0) 

PLTRISK  -0.1859  0.9034  0.57(0) 

COMPLEX  0.0087  0.5033  0.00(0) 

PAGBSSOW  0.3031  0.6170  1.62(1) 

NODIDS  0.5898  0.7595  8.53(1) 

PLHBSDEV  0.1785  0.8390  0.53(1) 

PLWBSL3  -0.0269  0.4872  0.01(0) 

PLDRRPP  -0.3854  0.6919  2.79(1) 

TECHDBPN  0.0000  1.0000  0.00(0) 

SOWDWBS  0.1393  0.9357  0.32(1) 

SOHCSSR  0.2562  0.8045  1.12(1) 

SOHSDISP  0.1045  0.9798  0.18(1) 

SONRCHP  -0.3148  0.8317  1.76(1) 

SOHRCBP  -0.1655  0.9409  0.45(1) 

SONPRSI  -0.0127  0.9143  0.00(1) 

MOPMDIDS  0.3953  0.7474  2.96(1) 

NOEVCRIT-0.2452  0.7659  1.02(1) 

BVSDISP  -0.1172  0.7511  0.22(1) 

BVRCMP  0.1322  0.6416  0.28(1) 

BVRCBP  0.0194  0.5137  0.01(1) 

F-  0.78 

SET  SPLSRISK  P>0. 47795(1) 

PLSRISKl-0.1179  0.8121  (1) 

PLSRISIC2-0.1781  0.9306  (1) 

F-  0.31 

#  SET  SPLTRISK  P>0. 73726(1) 

PLTRISKl-0.0617  0.8326  (1) 

PLTR1SX2-0.1S94  0.9039  (1) 

F-  0.34 

SET  SCOMPLEX  P-0.71934 (1) 

COMPLEXl  0.2070  0.8806  (1) 

..  CQMPLEX2-0.1361  0.6024  (1) 

F-  0.44 

SET  SPLNBSL3  P-0. 72860(1) 

PLWBSL31  0.2356  0.6517  (1) 

PLNBSL32  0.0731  0.7322  (1) 

PLNBSL33-0.0798  0.3415  (1) 


1-7 


STBP  NO 


4 


VMtZABLi  nrniiiD  i?  modios 

NOLTXnj;  R  0.9699 

NDLTIPLI  R-S<H»lll  0.9408 

AOJOSTB)  R-SQORRI  0.9186 

SID.  BUtOR  OF  1ST.  12.9S67 

AHRLYSIS  or  VRRZMICB 

StM  OP  SQOMIRS  OP  NSAH  SQDARB  P  RATIO 

RRORISSIOH  43686.492  6  7114.416  42.38 

RSSIDOAL  3686.0339  16  167.8764 


VARZABLBS  IN  SQCATION  VARlABUtS  HOT  IN  BQIIATION 


STD. ERR 

P  AND  P 

PARTIAL 

F  AND  P 

VARIABLE 

COBPF. 

OP  COBPF 

TOL.  RBMOVB(L) 

VARIABLB  CORR.  TOL. 

BNTBR(L) 

(CONSTANT  16.2540) 

NOBCPS  1.8609  0.1333  0.7661  195.10(1)  OCOSTCD  -0.1718  0.5879  0.46(1) 

PLPRSSCR  -58.1240  7.5148  0.8996  59.82(1)  CTYPB  0.1883  0.6707  0.55(1) 

N(U}IDS  0.4419  0.1513  0.7595  8.53(1)  D_OP  0.1978  0.6913  0.61(1) 

P-  8.63 

SBT  STSCHDBF  8-0.00124(1) 

TBCHDBPl  -14.3837  8.3060.5488  (1)  PRCffiOPT  -0.0364  0 . 8232 (0 . 890) (1) 

T1CHDBP3  -9.3813  9.6767  0.5436  (1) 

TRC1IDBP3  21.6174  7.8813  0.5180  (1) 

PLAQGR  -0.1726  0.6913  0.46(1) 

PLCOHC  0.3656  0.5698  2.31(1) 

PLSRXSK  0.0122  0.7112  0.00(0) 

PLTRISK  -0.1171  0.8811  0.21(0) 

CCMPLBX  -0.0109  0.5028  0.00(0) 

PAGBSSOW  0.3799  0.6170  3.53(1) 

PLNBSDBV  0.3730  0.8349  1.21(1) 

PUIBSU  0.0011  0.4861  0.00(0) 

PLDRRPP  -0.3549  0.6707  2.16(1) 

TBCHDBPN  0.0000  1.0000  0.00(0) 

SONDNBS  0.2813  0.9161  1.29(1) 

SONCSSR  0.3026  0.8042  1.51(1) 

SOWSDISP  0.0940  0.9775  0.13(1) 

SOWRCNP  -0.3272  0.8254  1.80(1) 

SONRCBP  -0.2514  0.9371  1.01(1) 

SOHPRSI  0.0155  0.9126  0.00(1) 

NOPMDIDS  0.2685  0.6698  1.17(1) 

MOBVCRlT-0.1980  0.7492  0.61(1) 

BVSDISP  -0.0069  0.7241  0.00(1) 

BVRCHP  0.1660  0.6416  0.43(1) 

BVRCBP  0.0238  0.5137  0.01(1) 

F-  0.03 

SBT  SPLSRISK  P-0.97504 (1) 

PLSRXSKl-0.0596  0.8007  (1) 

PI.SRXSK3  0.0303  0.8225  (1) 

F-  0.41 

SBT  SPLTRXSK  P-0. 67278(1) 

PLTRXSICl-0.1994  0.8101  (1) 

PLTRXSK3- 0.0574  0.8702  (1) 

F-  0.61 

SBT  SCOHPLBX  P-0. 55900(1) 

COHPLBXl  0.3823  0.8795  (1) 

C0MPLBX2- 0.2021  0.6013  (1) 

P-  0.54 

SBT  SPLHBSL3  P-0.66165 (1) 

PI<HBSL31  0.3334  0.6505  (1) 

PLHBSL3 2 -0.0630  0.7005  (1) 

PLWBSL33-0.0525  0.3402  (1)  * 


P-VALOBS(  0.100,  0.110)  OR  T0LBRANC8  INSUFFICXENT  FOR  FURTHER  STEPPING 
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StMttRY  TABLS 


STBP 

NO. 

VARIABU 

BNTBUDD  RIMOVSD 

MOLTIPLI 

R  RSQ 

CHAHGB 
IN  RSQ 

P-VALDB 

BHTBR 

P-VALUB 

RBMOVB 

NO. OP  VAR 
INCLODBD 

'IT 

1 

9  NOBCPS 

0.7793 

0.6073 

0.8073 

0.00 

1 

■  2 

10  PLPRBSCH 

0.8994 

0.8093 

0.2020 

0.00 

2 

3 

SIT  STBCBDBP 

40  TBCHDBPl 

41  TBCIIDBF2 

42  TBCHDIY3 

0.9S3S 

0.9092 

0.0999 

0.00 

5 

4 

17  NOOIDS 

0.9899 

0.9408 

0.0318 

0.01 

8 

SRRXM.  CORRKLATICW  -0.380S 
DDRBIN-»nTS(»l  STATISTIC  2.71S0  BASKD  W 


23  CASBS 


CASK  PLOTS 


CASK  LABBL 


RBSIDOALS 

STRBSIO 


LBVSRAOB 


-LOG  P(H) 


INFLDEMCB 

MODCOOK 


NO. 

-4 

-2 

0 

2 

4 

0 

1 

2 

3 

4 

0  1 

2 

3 

4 

5 

6 

♦  «  . 

....... 

. 

♦  .  .  . 

...... 

.  . 

.  ♦  . 

.  ♦  . 

.  ♦  . 

.  ♦  . 

1 

*** 

*** 

2- 

M 

N 

H 

3 

***• 

•  * 

4- 

M 

M 

M 

S 

***•8 

** 

6 

«* 

** 

7 

««* 

«• 

8 

* 

*• 

9 

**#« 

«* 

•  * 

10- 

M 

M 

N 

11 

•  * 

12 

* 

*««« 

# 

13 

14 

•  * 

*# 

15 

** 

#* 

16 

«« 

« 

*• 

17 

* 

*« 

18- 

M 

M 

N 

19 

* 

♦ 

*« 

20 

* 

•  •• 

21- 

M 

N 

N 

22 

«** 

23 

24- 

M 

M 

M 

25 

26 

•  *«« 

»«« 

• 

27 

««•« 

*** 

• 

28 

29 

. 

. 

•  V 

....... 

.  .+ 

♦  .  .  . 

.  .♦ 

.♦  . 

.  ♦  . 

.+ 

-4 

-2 

0 

2 

4 

0 

1 

2 

3 

4 

0  1 

2 

3 

4 

5 

6 

1-9 


5  .09 

♦ 

4- 

9 

- 

1 

- 

- 

1 

- 

-  1 

- 

1 

1 

- 

- 

1 

- 

- 

1  2 

1  11 

1 

- 

0.0 

*1 

1  1 

1 

!♦ 

♦ . .  ♦  .  .  . 

3. 

9. 

15 

21 

0. 

6. 

12 

18 

24 

UCOSTCD 

5 

BrntBMR  CASKS  •• 

CASB  NO.  COOK 

CASB  NO.  UCOSTCD 

27  0.2S78 

17 

25.7384 

3  0.2326 

25 

20.7504 

BXTRBNB  CASKS 

IN  THB  PLOTS  •• 

EXTRB«B 

CASE 

3 

9 

STATISTICS 

VALUB  NO. 

LABBL  WEIGHT 

SCHEDNOD 

k;i£CPS 

COOK 

0.2S78  27 

1.0000 

64. 

2000 

28.0000 

COOK 

0.2326  3 

1.0000 

-10. 

0000 

8.0000 

CASE 

10 

17 

40 

41 

NO.  LABBL 

PLPRBSCH 

NODIDS 

TBCHDBFl 

TECHDBF2 

27 

1.0000 

58.0000 

0.0000 

0. 

0000 

3 

1.0000 

100.0000 

0.0000 

1. 

0000 

CASB 

42 

NO.  LABBL 

TBCKDBP3 

27 

0.0000 

3 

0.0000 

LIST  or  ntSDlCTBD  VALOBS,  RBSZDOALS.  AND  VMUABLBS 

-  CASKS  WITH  MlSSim  VALOBS  ARB  MARKBD  WITH  A  MINDS  SIQI 
BBTHBBN  THB  CASB  NDHBBR  AND  CASK  LABBL. 

-  ASTBRISXS  (UP  TO  3)  TO  THB  RIGHT  OF  A  RBSIDUAL  INDICATB  THAT 
THB  RBSIDUAL  DBVIATBS  FROM  THB  MBAN  BY  HOta  THAN  THAT  NIMBER 
OF  STANDARD  DEVIATIONS. 

-  MISSING  VALUES  AMD  VALUES  OUT  OF  RANGB  ARB  DBNOTBD  BY 
VALUES  GRBATBR  THAN  OR  EQUAL  TO  2.12fl€t*37  IN  AB50LUTB  VALUB. 


I-IO 


CASI 

3 

51 

55 

MO.  LABIL 

PSBDICTBD 

MSIDOAL 

NBXQHT 

SCKIDMOO 

DSTSISIO 

HATDIAG 

X 

85.9048 

8.8952 

1.000 

94.8000 

0.7587 

0.2029 

2- 

2.12C8B07 

2.1271437*** 

1.000 

2.12681437 

2.12681437 

2.12681437 

3 

7.8228 

-17.8228* 

1.000 

-10.0000 

-1.8376 

0.3564 

4- 

2.1268B4-37 

2.127B437*** 

1.000 

2.12681437 

2.12681437 

2.12681437 

5 

128.8612 

3.0388 

1.000 

131.9000 

0.3126 

0.4687 

C 

15.5555 

-2.5555 

1.000 

13.0000 

-0.2197 

0.2416 

7 

8.4603 

4.9397 

1.000 

13.4000 

0.4322 

0.2613 

• 

33.9862 

-9.7862 

1.000 

24.2000 

-0.8022 

0.1333 

9 

4.2878 

19.5122* 

1.000 

23.8000 

1.9880 

0.3203 

10- 

2. 12681437 

2. 1271437*** 

1.000 

2.12681437 

2.12681437 

2.12681437 

11 

76.7534 

-2.3534 

1.000 

74.4000 

-0.2174 

0.3434 

12 

101.9670 

14.7330* 

1.000 

116.7000 

1.4717 

0.3595 

13 

-21.5188 

-6.3812 

1.000 

-27.9000 

-0.6164 

0.3864 

14 

24.5201 

7.8799 

1.000 

32.4000 

0.6502 

0 . 1566 

15 

25.8710 

4.1290 

1.000 

30.0000 

0.3571 

0.2472 

1C 

28.6584 

6.6416 

1.000 

35.3000 

0.5442 

0.1518 

17 

34.4280 

-4.9280 

1.000 

29.5000 

-0.3978 

0.1337 

18- 

2.12681437 

2.1271437*** 

1.000 

2.12681437 

2.12681437 

2.12681437 

19 

117.9730 

1.3270 

1.000 

119.3000 

0.1900 

0.7268 

20 

31.8703 

-15.8703* 

1.000 

16.0000 

-1.3550 

0.1402 

21- 

0.6167 

2.1271437*** 

1.000 

2.12681437 

2.12681437 

2.12681437 

22 

21.3164 

-3.0164 

1.000 

18.3000 

-0.2630 

0.2619 

23 

54.5605 

-7.7605 

1.000 

46.8000 

-0.7910 

0.4400 

24- 

94.5399 

2.1271437*** 

1.000 

2.12681437 

2.12681437 

2.12681437 

25 

146.7032 

-7.0032 

1.000 

139.7000 

-0.7439 

0.4868 

26 

91.3113 

-10.0113 

1.000 

81.3000 

-1.0685 

0.4725 

27 

35.8638 

28.3362** 

1.000 

64.2000 

3.0723 

0.2260 

28 

74.4330 

-8.7330 

1.000 

65.7000 

-0.7778 

0.2675 

29 

42.6106 

-3.2106 

1.000 

39.4000 

-0.2715 

0.2152 

CASI  S9 

KO.  LABXZ.  CXMK 


1 

0.0215 

2 

2.12681437 

3 

0.2326 

4 

2.12601437 

5 

0.0130 

6 

0.0023 

7 

0.0099 

8 

0.0145 

9 

0.2246 

10 

2.12681437 

11 

0.0038 

12 

0.1619 

13 

0.0356 

14 

0.0116 

15 

0.0063 

16 

0.0079 

17 

0.0037 

18 

2.12681437 

19 

0.0146 

20 

0.0406 

21 

2.12681437 

22 

0.0037 

23 

0.0719 

24 

2.12681437 

25 

0.0772 

26 

0.1448 

27 

0.2578 

28 

0.0324 

29 

0.0031 

I-ll 
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PRSOICTO 
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ORIUDTOD  NORMAL  RRMABILITY  PLOT  OF  OMMSIOirnD  RISIOOALS 
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VALOIS  FROM  NORMAL  DISTRIBUTION  WOOLO  LIB 
ON  THB  LINB  IHDICATID  BY  THI  SYMBOL  • 


BID  OF  INSTRUCTIONS 
PROGRAM  TBRMINATBD 


1-13 


pRoatMi  iNsmixmoiis 


/XMPOT  riU(>'TBSSIS.ASC’ . 
VMtZABLIS-33 . 

roKMKr-nin. 


/VMUABLI  HMIBS-CHO,  SCHIDPIR,  8CBKOMOO.  SCRDPLR.  OCOSTCD,  CTYPI, 

A  0  OP.  PRODOPT.  MOKPS,  PLPRR8CH,  PLMOR,  PLCOHC,  PLSRISK, 

PLIRISX.  COMPLBX.  PMRSSOM.  HOOIDS,  PLMBSOIV,  PLMBSU,  PLMBSLL, 
PliiRRFP,  nCHDIPM,  SONDNB8,  SOHCS«l.  SOHSDISP,  SONRCNP, 

SONRCBP.  SOWPRSZ,  NOPHDZOS,  1K»VCRZT,  SVSDISP,  IVRCNP,  IVRCSP. 


OSR-SCHIDPBR,  CTYPI,  PUkOOR.  PUXRIC,  PM3I8SON,  HOOIDS,  PLORRFP, 
SONCSSR,  SONRCBP,  SONPRSI,  N0PMDID8,  HOIVCRZT,  IVRCNP,  IVRCBP, 
OCOSTCD,  0  DP,  PRODOPT,  NOICPS.  PLmiSCH.  PLMBSOIV,  SONDNBS, 
SON8DZSP,  SONRCNP,  IVSDISP.  PLSRISK,  PLSRZSKl,  PLSRZSK3,  PLTRISK, 
PLTRISXl,  PLTRI8K3,  CONPLIX,  COMPLBXl,  C0MPLIX3,  TICHDIPM,  TICHDIFl, 
TICBDSP3,  TICHDirZ,  PLNBSL3,  PLNBSL31,  PLNBSL32,  PLNBSL33,  DDMMYl, 
OOMfYS,  D0MfY3,  OOMIY4,  DONMYS,  DOMtYS,  DOIMY?,  DOMHYS,  DDIMY9, 
DONMYIO,  OOMtYll,  DOMHYIS,  OaMIY32,  DtBMY23,  DDIMY24,  D0MIY2S, 
DaiMY2C,  OaMIY27,  DOMfYIS,  DOM4Y29.  D0MIY30,  DDM4Y31,  NPTRISKl, 
NPTRZ8K2,  MPTRZSK3,  MPTRISK4,  MHOICPSl,  MHOSCPS2,  NIIOBCPS3, 

MH0ICPS4,  MHOICPSS,  MMOICPS6,  MPSRISKl,  NPSRISK3,  HPRISCHl, 

HPRISCH2,  MPRSSCH3,  MPRBSCH4,  MPRB8CH6.  MPLMQOR,  MSONRC,  MPLC0HC3, 

NsoNsurr,  msvszht. 


/TRANSFCAM  IF  (PLSRISK 

■Q 

1) 

IF (PLSRISK 

BQ 

2) 

IF (PLSRISK 

■Q 

3) 

IF (PLTRISK 

BQ 

1) 

IF (PLTRISK 

BQ 

2) 

IF (PLTRISK 

BQ 

3) 

IF (CONPLIX 

BQ 

1) 

IF (CONPLIX 

BQ 

2) 

IF (CONPLIX 

BQ 

3) 

T11IM<PLSRISKl-0. 

TRSN(PLSRZSK1-1. 

T«DI(PLSRZSKl-0. 

THBN(PLTRISia-0. 

THBN(PLTRZS1U-1. 

THXN(PLTRZSKX-0. 

THRH(CONPLRXl-0. 
THBH(COMPLBXl-l. 
TH8N(C0HPLBX1>0 . 


PLSRZSK2-0 . ) . 
PLSRISK2-0.)  . 
PLSRZSK2til.)  . 

PLTRISK2-0.) . 
PLTRISK2-0.) . 
PLTRISX3-1.) . 

COMPLBX2-0.) . 
C0NPLBX2>0.)  . 
C0MPLBX2-1.) . 


IF(TBCHDSFN  IQ  1)  THBH (TECHDEF1>0 .  TECHDBF2-0.  TBCHDEF3-0 . ) . 
IFCTECHOIFN  EQ  2)  THIN (TECHDEFZ-1 .  TECHDEF2>0.  TECHDBF3 -0 . ) . 
IF(TECHDBFN  BQ  3)  TKBN(TBCHDBFZ>0 .  TBCHDBF2-1.  TBCHD8F3 -0 . ) . 
IF<TECHOBFN  BQ  4)  THBN(TBCHDBFl-0 .  TBCHDBF2-0.  TBCHDBF3-1 . ) . 


IF(PLNBSL3  BQ  0)  THBN(PLHBSL3Z-0 .  PLMBSL32-0.  PLNBSL33.0 . ) . 

ZF(PLNB8L3  GT  0  AND  PLNBSL3  LB  10)  THBN<PLMBSL31>1 .  PLMBSL32>0.  PLHBSL33-0 . ) . 
IF(PLNBSL3  err  10  AND  PLNBSL3  LB  16)  THBN(PLNBSL31>0 .  PLNBSL32>1.  PLHBSL3 3 -0 . ) . 
IF(PLNBSL3  <3T  16)  THBN(PLNBSL31>0 .  PLNBSL32-0.  PLNBSL33-1 . )  . 


MPTRZSIi:i>PLTRISK*NOBCPS . 
MPTRZSK2-PLTRZSK*PLNBSDBV 
NPTRISX3>PLTRISK*S0NDN8S . 
MPTRZSK4-PLTRISK*PLSRISK . 
MNOBCPS1>NOBCPS*PLCONC . 
HNOECPS2-NOBCPS*PL2»RFP . 
MNOBCPS3 -NOBCPS*BVSOISP . 
»aiOBCPS4>NOBCPS*TBCHDBFN . 
MNOBCPSS-NOBCPS*OCOSTCD . 
MNOBCPS6-HOBCPS*COMPLBX . 
NPSRISXi>iPLSRISK*PLPRBSCH 
NPSRZSIC3  -PLSRZSK*CQNPLIX . 
NPRBSCH1«PLPRBSCH*PLC0NC . 
MPRBSCH2 -PLPRBSCH*PLORRFP 
NPRBSCH3-PLPRBSCH*SONRCI(P 
MPRBSCM4>PLraiSCH*BVRCNP . 
NPLA06R«PLAGKai*S0HS0ISP . 
MSQNRC-SOMRCB9*SONRCHP . 
MPLCQHC3-PLC0NC* PLSRISK. 
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MFItB8CKC-PLPitBSCH*PLAaat*PLCCIiC . 
IISOMSZVT-SOIISDZSP*SaWlCWP*SOMRCBP . 
NIVSZllT->Va)ISP*KVRCNP*IVItCBP . 


IF(MPTR1SX2 

BQ 

0) 

THBM(DOMfYl-0. 

DDIBfY2-0. 

D0MtY3-0.)  . 

IF(MPT1USX2 

BQ 

1) 

TBBH(D0M(Y1-1. 

O0MfY2-0. 

O0MfY3-0.)  . 

IF(NPTRISK2 

BQ 

2) 

THBN(D0MfYl-0. 

DDMfY2-l. 

DOMtY3-0.)  . 

IF(NPTRZSK2 

BQ 

3) 

TNBN(D0HNYl-0. 

DDMKY2-0. 

D0MfY3-l.)  . 

ZF(NPTRZSK3 

BQ 

0) 

TRBM(D0MfY4-0. 

DOMfYS-O. 

DOMtYS-0 . )  . 

ZF(MPT1USX3 

BQ 

1) 

THBN(0aMfY4-l. 

DOMfYS-0. 

DOMtYC-0.)  . 

IF(NPTRISK3 

BQ 

2) 

TBXM(0(BBfY4-0. 

OOMfY5-l. 

D0MtY6-0 . )  . 

ZF(NPTRZSX3 

BQ 

3) 

THBN(DDMIY4-0. 

DOMIYS-0 . 

D0MfY6-l . )  . 

IF(MPLC0IIC3 

BQ 

0) 

TIIBH(0CMfY7.0. 

OOMfYS-0. 

D0M(y9-0.)  . 

IF(MPLC0BIC3 

BQ 

1) 

TIIBM(OOMIY7-1. 

DOMfYS-O. 

O0MtY9-0 . )  . 

IF(MPLCaHC3 

BQ 

2) 

THBN(D0MIY7-0 . 

OOMfY8-l. 

D0MfY9-0.)  . 

IF(MPLC0MC3 

BQ 

3) 

TRBH(OfBBfY7-0 . 

DOMfYS-O. 

D0MtY9-l.)  . 

IF(NPSRZ8X1 

■Q 

0) 

THBN(DDMIY10-0 

.  DOSBfYll- 

>0.  O0MfY12-0. 

)  . 

ZF(NPSRI8K1 

BQ 

1) 

TBBN(0aM(Y10-l 

.  DOMfYll- 

>0.  O0SBfY12-0. 

)  . 

IF(MPSRZ8IC1 

BQ 

2) 

TKBMCDOMfYlO-O 

.  DOMfYll- 

a.  D0MfY12-0. 

)  . 

IF(MPSRZSK1 

BQ 

3) 

TRBN(O0MtY10-0 

.  OOMfYll- 

>0.  D0SMY12-1. 

)  . 

IF(HPTRZSK4 

BQ 

1) 

TKBH(OaMNY22-0 

.  DaMtY23> 

<0.  D0MfY24-0. 

DOMfY2S-0. 

OaMfY26-0 . ) 

IF(MPTRISK4 

BQ 

2) 

TKBN(OaM(Y22-l 

.  DaMfY23- 

rO.  D0M<Y24-0. 

DOMfY2S-0 . 

DaMfY26-0 . ) 

IF(MPTRZSK4 

BQ 

3) 

T11BN(O0MtY32-0 

.  DaMfY23- 

>1.  D0MfY24-0. 

D0MfY2S-0. 

DaMfY26-0. ) 

IF(MPTRZSK4 

BQ 

4) 

THBN(00MfY32-0 

.  DaMfY23- 

>0.  D0MfY24-l. 

D0ltHY25-0. 

D0SBfY26-0 . ) 

IF(MPTRZSX4 

BQ 

6) 

THBN(DOHHY22-0 

.  D0MfY23> 

rO.  D0M(Y24-0. 

OaMfY25-l. 

DOMMY26-0. ) 

IF(MPTRISK4 

BQ 

9) 

THBN(DaMMY32-0 

.  D0MtY23- 

0.  D0MfY24-0. 

DDMtY2S-0. 

D0MfY26-l.) 

IF(MPSRZSK3 

BQ 

1) 

THBH(IXBB(Y27.0 

.  D0IBfY28-0.  DOMfY29-0. 

DDMfY30-0. 

DOMfY31-0.,) 

IF(MPSRZSX3 

BQ 

2) 

THBN(DQ8BIY27-1 

D0SfMY28- 

0.  O0MfY29-0. 

DDMfY30-0. 

DDMMY31-0.’) 

1F(HPSRZSK3 

BQ 

3) 

TllBM(OaMIY37-0 

OOMfY28- 

>1.  DOMfY29-0. 

D0MIY30-0. 

DOMfY31-0 . ) 

IF(MPSR1SK3 

BQ 

4) 

THBN(OaNHY27.0 

OOMfY2S- 

0.  D0M(Y29-1. 

DOMfy30-0. 

DOMfY31-0. ) 

IF(MPSRISK3 

BQ 

6) 

THBM(OOMMY37-0. 

OOMfY28- 

0.  DDMHY29-0. 

DOMtY30-l. 

DaMfY31-0.) 

IF(MPSRISK3 

BQ 

9) 

THBN(DDMfY37-0. 

D0MfY28- 

<0.  DOMfY29-0. 

D0MtY30-0. 

oaMIY31-l.) 

/QROOP  C0DBS(0  OP,  PIUXX)PT,  PLPRBSCH.  PLNBSOBV,  PLDRXFP,  SOMDNBS, 
SONSOISP,  SONRCNP,  BVSOISP,  CTYPH,  PLKCSR,  PUXPIC,  SOMCSSR, 
SONRCBP,  SONFRSI,  KVRCHP,  KVRCBP,  PLSRISKl,  PLSRISIQ, 

PLTRISKl,  PLTRXSK3,  CONPLBXl,  COMPLBU,  PLWBSUl,  PLWBSL32, 
PLNBSUa,  TBOODRFl,  TBC31DBF2,  TEC3!DBF3,  MPRBSCMl,  MPRBSC312, 
NPRBSCH3,  MPRBSCH4,  MPUCSt,  MSOHRC,  MSOHSINT,  MBVSIHT, 
MPRBSCHe,  DOWfYl,  OOMm.  DaM«y3,  DOMy4,  DOMfYS,  DOMfYS, 
DOMnrr,  OOIMYS,  DOIWYS,  DOMHYIO,  DOWYII,  OOMHYIZ,  DDMMY22, 
DaMY23,  D0WfY24,  DOMIY35,  0aMMY24,  Da»MY27,  DUIMY28,  DOmfY29, 
D(]N<Y30,  D0WIY31)>1,  0. 

NMOSCD  DP,  PRODOPT,  PURBSCH,  PLMBSDBV,  PLDRRFP,  SOMDMBS, 
SONSOISP,  SONRCNP,  BVSOISP,  CTYPB,  PLACGR,  PLCONC,  SONCSSR, 
SONRCBP,  SONFRSI,  BVRCNP,  BVRCBP,  PLSRISKl,  PLSRISKS, 

PLTRISKl,  PLTRZSK2,  CONPLBXl,  CCHPLBZ2,  PLN8SL31,  PLHBSL32, 
PLNBSL33,  TBCHDBFl,  TBCHDBF2,  TBCHDBF3,  MPRBSCHl,  NPRBSCH2, 
MPRBSCH3,  NPRBSCH4,  MPUkOGR,  MSONRC,  NSONSIOT,  MBVSZIIT, 
NPRBSCH6,  DDNHYl,  OOMfY3,  DDIMY3,  00IMY4,  DDHMY5,  DQMY6, 
OONHY7,  DOMfYS,  OOMIY9,  DDMIYIO,  DOMlYll,  DONNYll,  D0HMY22, 
DDW<Y23,  D0MfY24,  OOMIY2S,  DOMNY26,  DOMfYl?,  D0M<Y28,  DTMfY29, 
D0MfY30,  ODMtY31)-YBS,  NO. 

C(»BS(PLSRISK,  PLTRISK,  COHPLBX)-!,  2,  3. 

MAMBS (PLSRISK,  PLTRISK) >LON,  LONJfBD,  OTHBR. 

NMfBS  (COHPLBX) -LON,  NBD,  HI. 

CODBS(TBCHDBFN)-l,  2,  3,  4. 

NAMBS (TBCKDBFN) -ORAFT_A,  FULL_A,  DRAFT_B,  FDLL_B. 
COOBS(PLNBSL3)-l,  2,  3,  4. 

IIAMBS(PLNBSL3)-'ONDBR  2',  '2  11',  '11  17',  'OVBR_17' . 
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/RIORISS  OI»lilD-SC3ilDPIIl. 

amatasrnsnsnisiL.  spltmsk,  scxmplsx.  stschobf,  splhbsu, 

SPTRZSia,  SPTIUSIC3,  SPLCOHCS.  SPSIIISKI,  SraiISK4,  SPSRISK3 . 
SPLSRZSK-PLSRISXl,  PLSRZSn. 

SPLTUSK-PLTIUSKl,  PLTRISU . 

SCONPLSX-CONPLSXl.  COMPUOa. 

STBCHOIF-TBCHDBPl,  TICHDIP2,  TKHDBPS . 

SPIMBSU-PLNBStJl,  PUIB8L32.  PLHBSL33 . 
svniaiamoamn.  ocMnra,  DOMm. 

SPTIU8X3-OI]Mnr4,  DCMffS.  DCMIYC. 
sptcoHca-ODMnrr,  oamat.  oamna. 
spsMsxi-ooMyio,  ooMiyii,  mmnna. 

SPTRZSK4-IK»Mr22.  OOMNnS.  0(Miy24,  OQMiy25,  OOMiy2« . 

spsRZSxa-ooMfln?,  oownt.  d(mr2»,  ocMiyao.  ooNMrai. 

IMPVJkL-O.l.  0.1. 

OOTPVALaO.il.  0.11. 

IHDIPIIID-CTyPI.  PLAOCR,  PLCCHC.  PAOSSSON.  HOOIDS,  PLMtRFP, 
SONCS8S.  SONRCBP.  SOMPRSI.  HOPMDZOS.  NOIVaUT,  IVRCNP. 

IVRCBP,  OCOSTCO,  0  OP.  PRODOPT.  M0SCP8.  PLPRXSCH.  PLHBSOIV. 
SONONBS.  SONSDISP.'SOWICWP.  BVSOISP.  SPLSRISK.  SPLTRZSK. 

SCOMPLSX.  SnCKDIF.  8PL»fB8L3.  8PTilISX2.  SPTRISIC3.  SPLCONC3. 
8PSRZ8IC1.  8PTIU8K4.  8P8RI8K3.  NPT1USK1.  MNOBCPSl.  MIIOKCPS2, 
MliOICP83.  MII0RCP84.  MII08CP8S.  MMORCPS6.  MPItB8CHl,  MPRSSCH2, 
MPM8CH3.  MPRXSai4.  MPIAOOR.  M80iaiC.  NPRZSCHS,  MSOMSIKT,  MSVSIHT. 
TOLaO.l. 

/PRINT  LKVRLaMIHZMM.. 

HO  DATA. 

NO  CORR. 

STEP. 

ANOVA. 

HO  COVA. 

NO  PART. 

NO  cxnp. 

NO  PRAT. 

NO  RRBQ. 

CASB-0 . 

LZNBSIZtaSO . 

/PLOT  RBSIODALS. 

ONORMAL. 

SIZBaCO.  25. 

CASBPLOTS. 

XVAR-nCOSTCD . 

YVARaCOOK. 

STBPaALL. 

NO  DATA. 

/BND 


NDMBBR  OF  CASB8  RBAD .  29 

CA8BS  WITH  DATA  NZSBING  OR  BBYONO  LIMITS  .  .  4 

RBMAININO  NDMBBR  OP  CASES .  25 
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DISCRIPTIVI  STATISTICS  OF  DATA 


VARIABUt  TOTAL 

STANDARD 

SXBW- 

SMALLBST 

LAROBST 

NO. 

NM4> 

FRBQ. 

MBAN 

DBV. 

MBSS  KORTOSIS 

VALOB  Z-SCR 

VALOB 

Z-SCR 

2 

SCHIDPBR 

25 

70.768 

81.812 

1.714 

2.723 

-27.900  -1.21 

334.00 

3.22 

6 

CTTPB 

25 

.36000 

.48990 

0.549 

-1.765 

0.0000  -0.73 

1.0000 

1.31 

11 

FLAGUR 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -O.SS 

1.0000 

1.74 

12 

PLCOIK 

25 

.44000 

.50662 

0.227 

-2.025 

0.0000  -0.87 

1.0000 

1.11 

16 

FAOBSSON 

25 

38.920 

18.216 

0.885 

0.027 

16.000  -1.26 

87.000 

2.64 

17 

NOOZOS 

25 

60.600 

20.294 

0.064 

-0.930 

25.000  -1.75 

100.00 

1.94 

21 

FLUOUPP 

25 

. 80000 

.40825 

-1.411 

-0.005 

0.0000  -1.96 

1.0000 

0.49 

24 

SOMCSSR 

25 

.40000 

.50000 

0.384 

-1.925 

0.0000  -0.80 

1.0000 

1.20 

27 

SOMRCBP 

25 

.64000 

.48990 

-0.549 

-1.765 

0.0000  -1.31 

1.0000 

0.73 

28 

SONPRSZ 

25 

.88000 

.33166 

-2.200 

2.962 

0.0000  -2.65 

1.0000 

0.36 

29 

NOPMDZDS 

25 

7.3600 

2.3072 

0.123 

-0.763 

3.0000  -1.89 

12.000 

2.01 

30 

NOBVaUT 

25 

3.9600 

2.4576 

1.418 

1.473 

1.0000  -1.20 

11.000 

2.86 

32 

BVRCNF 

25 

.80000 

.40825 

-1.411 

-0.005 

0.0000  -1.96 

1 . 0000 

0.49 

33 

BVRCBF 

25 

.64000 

.48990 

-0.549 

-1.765 

0.0000  -1.31 

1.0000 

0.73 

S 

OCOSTCD 

25 

9.0161 

7.3135 

0.548 

-0.825 

.10166  -1.22 

25.738 

2.29 

7 

D_DP 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

8 

mODOFT 

25 

.60000 

.50000 

-0.384 

-1.925 

0.0000  -1.20 

1.0000 

0.80 

9 

tiOBCFS 

25 

28.440 

22.862 

1.497 

1.641 

5.0000  -1.03 

95.000 

2.91 

10 

PLFRBSCH 

25 

.80000 

.40825 

-1.411 

-0.005 

0.0000  -1.96 

1.0000 

0.49 

18 

FLNBSOBV 

25 

.76000 

.43589 

-1.145 

-0.712 

0.0000  -1.74 

1.0000 

O.SS 

23 

SONDNBS 

25 

.80000 

.40825 

-1.411 

-0.005 

0.0000  -1.96 

1.0000 

0.49 

25 

SONSOISF 

25 

.72000 

.45826 

-0.922 

-1.193 

0.0000  -1.57 

1.0000 

0.61 

26 

SOWRCWF 

25 

.76000 

.43589 

-1.145 

-0.712 

0.0000  -1.74 

1.0000 

0.55 

31 

BVSOISP 

25 

.56000 

.50662 

-0.227 

-2.025 

0.0000  -1.11 

1.0000 

0.87 

13 

PLSRISX 

25 

2.2400 

.92556 

-0.462 

-1.714 

1.0000  -1.34 

3.0000 

0.82 

34 

PLSRISKl 

25 

.12000 

.33166 

2.200 

2.962 

0.0000  -0.36 

1.0000 

2.65 

35 

PLSRISK2 

25 

.56000 

.50662 

-0.227 

-2.025 

0.0000  -1.11 

1.0000 

0.87 

14 

PLTRISK 

25 

2.1200 

.92736 

-0.224 

-1.845 

1.0000  -1.21 

3.0000 

0.95 

36 

PLTRISKl 

25 

.16000 

.37417 

1.745 

1.092 

0.0000  -0.43 

1.0000 

2.24 

37 

FLTRIS1C2 

25 

.48000 

.50990 

0.075 

-2.072 

0.0000  -0.94 

1.0000 

1.02 

IS 

COMFLBX 

25 

1.9600 

.73485 

0.056 

-1.222 

1.0000  -1.31 

3.0000 

1.42 

38 

COMFLBXl 

25 

.48000 

.50990 

0.075 

-2.072 

0.0000  -0.94 

1.0000 

1.02 

39 

CaHFLBX2 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

22 

TBCHDBFN 

25 

2.6800 

1.1446 

-0.187 

-1.474 

1.0000  -1.47 

4.0000 

1.15 

40 

TBCHDBPl 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

41 

TBCHDBF2 

25 

s24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

42 

TBCHOBF3 

25 

.32000 

.47610 

0.726 

-1.530 

0.0000  -0.67 

1.0000 

1.43 

19 

FLHBSL3 

25 

12.840 

16.069 

2.057 

4.263 

0.0000  -0.80 

70.000 

3.56 

43 

FLHBSL31 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

44 

FI.NBSL32 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

45 

FLHBSL33 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

68 

OOMITl 

25 

.28000 

.45826 

0.922 

-1.193 

0.0000  -0.61 

1.0000 

1.57 

69 

DOM<Y2 

25 

0.0000 

0.0000 

0.0000 

0.0000 

70 

DOHHTS 

25 

.48000 

.50990 

0.075 

-2.072 

0.0000  -0.94 

1.0000 

1.02 

71 

oaMnr4 

25 

.32000 

.47610 

0.726 

-1.530 

0.0000  -0.67 

1.0000 

1.43 

72 

DDMfTS 

25 

.04000 

.20000 

4.416 

18.235 

0.0000  -0.20 

1.0000 

4.80 

73 

DOMIYS 

25 

.44000 

.50662 

0.227 

-2.025 

0.0000  -0.87 

1.0000 

1.11 

74 

DlWMy7 

25 

.08000 

.27689 

2.912 

6.757 

0.0000  -0.29 

1.0000 

3.32 

75 

DDMflTB 

25 

.08000 

.27689 

2.912 

6.757 

0.0000  -0.29 

1.0000 

3.32 

76 

DDMIYF 

25 

.28000 

.45826 

0.922 

-1.193 

0.0000  -0.61 

1.0000 

1.57 

77 

OOWTIO 

25 

.24000 

.43589 

1.145 

-0.712 

0.0000  -0.55 

1.0000 

1.74 

78 

Dawnrii 

25 

.12000 

.33166 

2.200 

2.962 

0.0000  -0.36 

1.0000 

2.65 

79 

DDMHT12 

25 

.44000 

.50662 

0.227 

-2.025 

0.0000  -0.87 

1.0000 

1.11 

80 

D(]MMy22 

25 

.16000 

.37417 

1.745 

1.092 

0.0000  -0.43 

1.0000 

2.24 

81 

OCM(T23 

25 

.20000 

.40825 

1.411 

-0.005 

0.0000  -0.49 

1.0000 

1.96 

82 

OaMNT24 

25 

.04000 

.20000 

4.416 

18.235 

0.0000  -0.20 

1.0000 

4.80 

83 

DOIMY25 

25 

.04000 

.20000 

4.416 

18.235 

0.0000  -0.20 

1.0000 

4.80 

84 

0(»B(y26 

25 

.40000 

.50000 

0.384 

-1.925 

0.0000  -0.80 

1.0000 

1.20 

85 

DDHMy27 

25 

.12000 

.33166 

2.200 

2.962 

0.0000  -0.36 

1.0000 

2.65 

86 

OOMNY28 

25 

.16000 

.37417 

1.745 

1.092 

0.0000  -0.43 

1.0000 

2.24 

87 

DDIMT29 

25 

.08000 

.27689 

2.912 

6.757 

0.0000  -0.29 

1.0000 

3.32 

88 

OOMfT30 

25 

.32000 

.47610 

0.726 

-1.530 

0.0000  -0.67 

1.0000 

1.43 

89 

DOMKTSl 

25 

.16000 

.37417 

1.745 

1.092 

0.0000  -0.43 

1.0000 

2.24 

46 

MFTRISKl 

25 

61.120 

67.633 

2.299 

4.581 

8.0000  -0.79 

285.00 

3.31 

47 

MFTRZS1C2 

25 

1.7200 

1.3077 

-0.143 

-1.815 

0.0000  -1.32 

3.0000 

0.98 

48 

NPTRISK3 

25 

1.7200 

1.2423 

-0.111 

-1.733 

0.0000  -1.38 

3.0000 

1.03 

49 

NVTRISK4 

25 

5.0800 

3.4269 

0 . 167 

-1.861 

1.0000  -1.19 

9.0000 

1.14 

SO 

MMOBCPSl 

25 

7.6400 

10.988 

1.323 

0.792 

0.0000  -0.70 

39.000 

2.85 

51 

MIIORCRS2 

25 

19.720 

20.824 

1.930 

4.359 

0.0000  -0.95 

95.000 

3.62 

52 

MliOBCPS3 

25 

19.360 

27.004 

1.466 

1.180 

0.0000  -0.72 

95.000 

2.80 

S3 

MNOBCRS4 

25 

69.400 

57.833 

1.681 

2.364 

5.0000  -1.11 

255.00 

3.21 

54 

MNOBCPSS 

25 

318.36 

449.12 

2.143 

4.769 

1.6266  -0.71 

1971.3 

3.68 

55 

HNOBCPS6 

25 

61.440 

64.520 

1.888 

3.421 

5.0000  -0.87 

285.00 

3.46 

5C 

NPSRISKl 

25 

1.8000 

1.2247 

-0.287 

-1.618 

0.0000  -1.47 

3.0000 

0.98 

57 

MPSRZSK3 

25 

4.5600 

2.7092 

0.257 

-1.230 

1.0000  -1.31 

9.0000 

1.64 

58 

NPRB8CH1 

25 

.36000 

.48990 

0.549 

-1.765 

0.0000  -0.73 

1.0000 

1.31 

59 

MPRBSCH2 

25 

.64000 

.48990 

-0.549 

-1.765 

0.0000  -1.31 

1.0000 

0.73 

80 

NPRBSCH3 

25 

.56000 

.50662 

-0.227 

-2.025 

0.0000  -1.11 

1.0000 

0.87 

61 

MPRB8CH4 

25 

.64000 

.48990 

-0.549 

-1.765 

0.0000  -1.31 

1.0000 

0.73 

65 

NPRBSCH6 

25 

.12000 

.33166 

2.200 

2.962 

0.0000  -0.36 

1.0000 

2.65 

62 

MPLAGGBl 

25 

.20000 

.40825 

1.411 

-0.005 

0.0000  -0.49 

1.0000 

1.96 

63 

MSOMRC 

25 

.64000 

.48990 

-0.549 

-1.765 

0.0000  -1.31 

1.0000 

0.73 

64 

MPLCONC3 

25 

1.0800 

1.3515 

0.542 

-1.614 

0.0000  -0.80 

3.0000 

1.42 

66 

MSOHSINT 

25 

.44000 

.50662 

0.227 

-2.025 

0.0000  -0.87 

1.0000 

1.11 

67 

MBVSINT 

25 

.44000 

.50662 

0.227 

-2.025 

0.0000  -0.87 

1.0000 

1.11 

**•  N  O  T  B  **•  KORTOSIS  VALOBS  GREATER  THAN  ZBRO  INDICATE  A  DISTRIBUTION  NITH 
HBAVIBR  TAILS  THAN  NORMAL  DISTRIBUTION. 


STBP  NO. 


0 


STD.  BRROR  OF  BST.  81.8118 

ANALYSIS  OF  VARIANCE 

SOM  OF  SQUARES 
RESIDUAL  160638.20 

VARIABLES  IN  EQUATION 


DP  MEAN  SQUARE 
24  6693.175 

VARIABLES  NOT  IN  EQUATION 


STD. ERR  F  AND  P  PARTIAL  F  AND  P 

VARIABLE  COEFF.  OF  COEFF  TOL.  REMOVECL)  VARIABLE  CORR.  TOL.  ENTER(L) 


(CCBiSTANT  70.7680) 


CTYPE  -0.2596 

1.0000 

1.66(1) 

PLAGGR  0.1434 

1.0000 

0.48(1) 

PLCaiC  -0.0428 

1.0000 

0.04 (1) 

PAGESSOW- 0.2173 

1.0000 

1.14(1) 

NOOIDS  -0.1517 

1.0000 

0.54(1) 

PLDRRFP  -0.3649 

1.0000 

3.53(1) 

SOWCSSR  -0.2076 

1.0000 

1.04(1) 

SONRCBP  -0.1018 

1.0000 

0.24(1) 

SOHFRSI  0.1376 

1.0000 

0.44(1) 

NOPMDIDS- 0.0194 

1.0000 

0.01(1) 

NOEVCRIT- 0.0979 

1.0000 

0.22(1) 

BVRCWP  -0.1319 

1.0000 

0.41(1) 

EVRCBP  -0.0333 

1.0000 

0.03 (1) 

UCOSTCD  -0.0836 

1.0000 

0.16 (1) 

D  DP  -0.1893 

1.0000 

0.85(1) 

PROOOPT  0.2608 

1.0000 

1.68(1) 

NOECPS  0.3935 

1.0000 

4.21(1) 

PLPRESCH-0.4452 

1.0000 

5.69(1) 

PLWBSDEV-0.3460 

1.0000 

3.13(1) 

SOWDWBS  -0.1459 

1.0000 

0.50(1) 

SOHSDISP- 0.4224 

1.0000 

4.99(1) 

SOWRCWP  -0.1637 

1.0000 

0.63 (1) 

EVSDISP  0.0762 

1.0000 

0.13(1) 

PLSRISK  -0.1037 

1.0000 

0.25(0) 

F. 

0.75 

SET  SPLSRISK 

P>0. 

.48413  (1) 

PLSRISKl- 0.2191 

1.0000 

(1) 

PLSRISK2- 0.0230 

1.0000 

(1) 

PLTRISK  -0.0314 

1.0000 

0.02 (0) 

F- 

4.91 

SET  SPLTRISK 

P-0. 

.01721(1) 

PLTRISKl  0.5557 

1.0000 

(1) 

PLTRISK2-0.2324 

1.0000 

(1) 

COMPLEX  -0.1431 

1.0000 

0.48(0) 

F- 

0.77 

SET  SCOMPLEX 

P-0. 

.47461(1) 

COMPLEXl-0.2196 

1.0000 

(1) 

COMPLEX!  0.0078 

1.0000 

(1) 

TECHDEFN  0.0493 

1.0000 

0.06  (0) 

F» 

1.27 

SET  STECHDEF 

P-0. 

.31000(1) 

TBCHOBFl-0.0241 

1.0000 

(1) 

TECHDEF2  0.3783 

1.0000 

(1) 

TECHDEF3-0.1840 

1.0000 

(1) 

PLWBSL3  -0.1657 

1.0000 

0.65(0) 

F- 

1.10 

SET  SPLHBSL3 

P-0. 

.37055(1) 

PLWBSL31  0.1207 

1.0000 

(1) 

PLHBSL32-0.2213 

1.0000 

(1) 

PLHBSL3 3 -0.1977 

1.0000 

(1) 

F- 

1.54 

SET  SPTRISK2 

P-0 

.23715(1) 

DUMMYl  -0.0704 

1.0000 

(1) 

DUMMY2  0.0000 

1.0000 

(1) 

DUMKY3  -0.2324 

1.0000 

(1) 

4 


P 


J-6 


SBT  SPTRISK3 
DDMff*  -0.1379 
DOWYS  0.489S 
DtMfYS  -0.1812 

SBT  SPLC0IIC3 
DCtOfY?  -0.0422 
OOMYO  -0.1S62 
DOMfYS  0.0726 

SBT  SPSRISKl 
DOMYIO  -0.1264 
OOlWYll  -0.2191 
DaMfY12  -0.1065 

SBT  SPTRISK4 
DDMMY22  0.2570 
DDMMY23  -0.1872 
DI9MY24  -0.1471 
DaMY25  0.4895 
DaW(Y26  -0.1516 

SBT  SPSRISIC3 
DaMMY27  -0.0190 
S(MIY28  0.0578 
DDMMY29  -0.1768 
DDMMY30  -0.1689 
DDWtYll  0.0676 
MPTRISKl  0.3222 
MPTRISIC2-0.2966 
MPTRISIC3 -0.1169 
MPTRISK4-0.0765 
MNOBCPSl  0.1027 
MNOBCPS2  0.0875 
MNOECPS3  0.2144 
MMOBCPS4  0.4421 
MNOBCPSS  0..2054 
MN0BCPS6  0.2576 
MPSRISK1-0.29S9 
MPSRISK3 -0.1143 
MPRESCHl-0.0829 
MPRBSCH2-0.4014 
MPRESCH3-0.4996 
MPRESC3i4-0.2073 
MPRESCH6  0.1611 
MPLAGGR  -0.0868 
M50WRC  -0.1018 
MP1.CONC3  0.0012 
MSOWSINT-0.276e 
MBVSINT  0.0289 


P- 

2.70 

P>0. 

07166(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

F> 

0.21 

P>0. 

.89055 (1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

F> 

1.97 

P-0. 

.14993(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

F- 

2.04 

P-0 

.11902(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

F- 

0.43 

P-0 

.81958(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

2.66(1) 

1.0000 

2.22(0) 

1.0000 

0.32 (0) 

1.0000 

0.14 (0) 

1.0000 

0.25(1) 

1.0000 

0.18(1) 

1.0000 

1.11(1) 

1.0000 

5.59(1) 

1.0000 

1.01(1) 

1.0000 

1.64(1) 

1.0000 

2.21(0) 

1.0000 

0.30(0) 

1.0000 

0.16(1) 

1.0000 

4.42(1) 

1.0000 

7.65(1) 

1.0000 

1.03 (1) 

1.0000 

0.61(1) 

1.0000 

0.17(1) 

1.0000 

0.24(1) 

1.0000 

0.00(0) 

1.0000 

1.91(1) 

1.0000 

0.02(1) 

J-7 


STIP  NO. 


1 


V3UUABLI  nrmtxs  so  mpriscso 

MOLTIPUt  R  0.4996 

NDLTIPLI  R-SQORRX  0.3496 

ADJUSTID  R-SQOMIB  0.2169 

STO.  ntIU»  OP  SST.  72.3954 


MaU.YSIS  OP  VMIIIANCB 


SDN  OP  SQOARES 

OP 

MEAN  SQOARE 

P  RATIO 

REQRESSIOM 

40091.109 

1 

40091.11 

7.65 

RESIDOAL 

120545.10 

23 

5241.091 

A 


VARIABLES  IN  tQOATION 


VARIABLES  NOT  IN  EQUATION 


VARIABLE  COEPP. 


(CONSTANT  115. 9455) 
MPRBSCH3  -80.6740 


STD. ERR  P  AMD  P  PARTIAL  P  AMD  P 


OP  COEPP  TOL. 

REMOVE (L) 

VARIABLE  CORR. 

TOL. 

ENTER (L) 

39.1689  1.0000 

7.65(1) 

CTYPE  -0.2095 

0.9740 

1.01(1) 

PLAGOR  0.2369 

0.9854 

1.31(1) 

PLCOHC  -0.0644 

0.9993 

0.09(1) 

PAOESSON-0.3373 

0.9983 

1.20(1) 

N(H>IDS  -0.1784 

1.0000 

0.72(1) 

PLDRRPP  -0.3336 

0.9740 

2.74(1) 

SONCSSR  -0.3021 

0.9957 

0.94(1) 

SOHRC3P  0 . 3724 

0.5400 

3.54(1) 

SOWPRSI  0.1134 

0.9937 

0.29(1) 

MOPMDIDS  0.0596 

0.9801 

0.08(1) 

MOBVCRIT-0.0830 

0.9973 

0.15(1) 

BVRCWP  -0.1757 

0.9984  ’ 

0.70(1) 

BVRCBP  -0.0345 

1.0000 

0.03(1) 

OCOSTCD  -0.0571 

0.9953 

0.07(1) 

D  DP  -0.2583 

0.9954 

1.57(1) 

mCHX>PT  0.2637 

0.9957 

1.64(1) 

NOBCPS  0.3940 

0.9882 

4.04(1) 

PLFRBSC»-0.2284 

0.6818 

1.21(1) 

PLHBSDEV-0.3601 

0.9342 

1.60(1) 

SONDMBS  -0.1918 

0.9984 

0.84 (1) 

SOHSDISP-0.49S9 

0.9998 

7.17(1) 

SOHRCNP  0.2284 

0.5981 

1.21(1) 

EVSDISP  0.3099 

0.8770 

2.34 (1) 

PLSRISK  -0.1382 

0.9990 

0.43 (0) 

F- 

0.28 

SET  SPLSRISK 

P-0. 

,76107(1) 

PLSRISICl-0.0679 

0.8929 

(1) 

PLSRISX2- 0.1063 

0.9814 

(1) 

PLTRISK  0.0315 

0.9863 

0.02(0) 

F> 

3.60 

SET  SPLTRISK 

P-0. 

.04524(1) 

PLTRISKl  0.5033 

0.9257 

(1) 

PLTRISK2- 0.1525 

0.9574 

(1) 

COMPLEX  -0.1293 

0.9961 

0.37(0) 

F- 

0.37 

SET  SCOMPLEX 

P-0. 

.69422(1) 

CC  2PLEX1-0.1373 

0.9574 

(1) 

COMPLEX2-0.0302 

0.9954 

(1) 

TECHDEFN  0.0354 

0.9986 

0.03 (0) 

P- 

1.30 

SET  STECHDEP 

P-0. 

.30208(1) 

TECHDEPl-0.1819 

0.9342 

(1) 

TE(3iDEP3  0.3985 

0.9954 

(1) 

TECHDEP3- 0.1613 

0.9919 

(1) 

PLNBSL3  -0.0110 

0.9018 

0.00(0) 

F- 

0.23 

SET  SPLNBSL3 

P-0. 

.87360(1) 

PLWBSL31-0.0090 

0.9342 

(1) 

PLNBSL32  0.0367 

0.7519 

(1) 

PLNBSL33 -0.1598 

0.9854 

(1) 

m 


J-8 


SBT  SPTRISU 
DDMflri  -0.0730 
DOMflra  0.0000 
ocawya  -o.is25 

SBT  SPTRISX3 
DCM(y4  -0.2078 
DCMNYS  0.4442 
DOMYS  -0.1318 

SBT  SPLCCI1C3 
ODMflrr  -0.2551 
OIBWY8  -0.0307 
OOMMY9  0.0921 

SBT  SPSRISKl 
DOMMYIO  -0.0769 
OOMMYll  -0.0679 
D0IMyi3  -0.0447 

SBT  SPTRISK4 
D1MIIY22  0.2667 
DlMflr23  -0.1930 
DO»My24  -0.0666 
DDIMY25  0.4442 
DtJMMY26  -0.1374 

SBT  SPSRISK3 
DaiMy27  0.0238 
DaMMy28  0.1653 
DtM(y29  -0.0553 
Dl]MMy30  -0.1437 
DDMKY31  -0.0823 
MPTRISKl  0.3303 
MPTRISK2- 0.2066 
MPTRISIC3 -0.1000 
MPTRISK4 -0.0623 
MNOBCPSl  0.0066 
MNOBCPS2  0.0006 
MiiOBCPS3  0.3181 
HNOECPS4  0.4147 
MN08CPS5  0.1783 
MNOECPS6  0.2355 
MPSRISKl-0.1269 
NPSRISK3-0.1824 
MPRBSC311-0.0028 
MPRBSCH2-0.196S 
MPRBSCH4-0.0445 
MPRBSCH6  0.2324 
MPLAGGR  0.0405 
MSOWRC  0.3724 
MPLCONC3  0.0323 
MS(3MSIIIT-0.0602 
MBVSINT  0.1131 


Fm 

0.77 

P>0. 

47675(1) 

0.9998 

(1) 

1.0000 

(1) 

0.9574 

(1) 

F- 

2.29 

P-0. 

.10931(1) 

0.9931 

(1) 

0.9470 

(1) 

0.9814 

(1) 

P- 

0.48 

P>0. 

.69790(1) 

0.8893 

(1) 

0.9317 

(1) 

0.9998 

(1) 

F- 

0.41 

P-0 

.74593(1) 

0.9854 

(1) 

0.8929 

(1) 

0.9814 

(1) 

F> 

1.59 

P>0 

.21424 (1) 

0.9972 

(1) 

0.9984 

(1) 

0.9673 

(1) 

0.9470 

(1) 

0.9957 

(1) 

F- 

0.21 

P-0 

.95202(1) 

0.9937 

(1) 

0.9721 

(1) 

0.9317 

(1) 

0.9919 

(1) 

0.9257 

(1) 

0.9946 

2.69(1) 

0.9392 

0.98(0) 

0.9963 

0.22(0) 

0.9980 

0.09(0) 

0.9622 

0.00(1) 

0.9697 

0.00(1) 

0.9859 

2.48(1) 

0.9686 

4.57(1) 

0.9893 

0.72(1) 

0.9879 

1.29(1) 

0.8483 

0.36(0) 

0.9926 

0.76(0) 

0.9740 

0.00(1) 

0.7395 

0.88(1) 

0.8827 

0.04 (1) 

0.9937 

1.26(1) 

0.9416 

0.04 (1) 

0.5400 

3.54(1) 

0.9971 

0.02(0) 

0.7874 

0.08(1) 

0.9814 

0.28(1) 

STIP  NO. 


3 


VMlZABUt  BNTBRSD  25  SONSOISP 

MOLTIPLB  R  0 . 6589 

NOLTIPLI  R-SQOMIB  0.4341 

ADJUSnO  R-SQOARB  0.3827 

STD.  ERROR  OP  BST.  64.2803 

ANALYSIS  OP  VARlANd 

SQM  OP  SOOARSS  DP  MSAH  SgOARS  P  RATIO 

RXattSSION  69733.173  2  34866.59  8.44 

RISIDOAL  90903.039  23  4131.957 


VARIABLES  IN  EQOATiaH  VARIABLES  NOT  IN  EQOATIOH 


STD. ERR 

P  AND  P 

PARTIAL 

P  AND  P 

VARIABLE 

COEPP. 

OP  COEPP 

TOL.  REMOVE (L) 

VARIABLE  CORE.  TOL. 

BNTBR(L) 

(CONSTANT  171.7258) 

SONSDISP  -76.6979  28.6357  0.9998  7.17(1)  CTYPE  -0.1850  0.9643  0.74(1) 

MPRESCH3  -81.6701  25.9019  0.9998  9.94(1)  PUUXai  0.3591  0.9648  3.11(1) 

PLCONC  -0.0662  0.9991  0.09(1) 

PAOESSON-0.3339  0.9834  2.64(1) 

NODIDS  -0.1494  0.9901  0.48(1) 

PLDRRPP  -0.3072  0.9555  2.19(1) 

SOMCSSR  -0.1506  0.9743  0.49(1) 

SONRCBP  0.3640  0.5325  3.21(1) 

SOHPRSI  -0.0030  0.9401  0.00(1) 

NOPMDIDS  0.1514  0.9603  0.49(1) 

NOEVCRIT- 0.0589  0.9931  0.07(1) 

EVRCNP  -0.3546  0.9903  1.46(1) 

EVRCBP  -0.0953  0.9907  0.19(1) 

IX»STCD  -0.0038  0.9836  0.00(1) 

0  DP  -0.10400.8732  0.23(1) 

PROOOPT  0.1227  0.8879  0.32(1) 

KOECPS  0.4394  0.9*76  5.02(1) 

PLPRESCH-0.167S  0.6617  0.61(1) 

PLNBSI»V-0.0132  0.6963  0.00(1) 

SONCWBS  -0.0188  0.8718  0.01(1) 

SONRCNP  0.1675  0.5805  0.61(1) 

EVSDISP  0.3513  0.8770  2.95(1) 

PLSRISK  -0.1775  0.9980  0.68(0) 

P-  0.48 

SET  SPLSRISK  P>0. 62645(1) 

PLSRISIU-0.1030  0.8913  (1) 

PLSRISK2- 0.1317  0.9811  (1) 

PLTRISK  -0.0865  0.9431  0.16(0) 

P-  0.60 

SET  SPLTRISX  P-0. 55680(1) 

PLTRISKl  0.3374  0.4303  (1) 

PLTR2SIC2- 0.1368  0.9539  (1) 

COMPLEX  -0.0371  0.9504  0.02(0) 

P-  0.15 

SET  SCOMPLEX  P-0.86155 (1) 

CaMPLBXl- 0.1193  0.9539  (1) 

CaMPLEX2  0.0463  0.9755  (1) 

TECIlDEPN-0.0159  0.9888  0.01(0) 

P-  0.74 

SET  STECBDEP  P-0. 54301(1)  » 

TEaiDEPl-0.1291  0.9151  (1) 

TECHDEP3  0.3139  0.9190  (1) 

TECBDEP3-0.1S89  0.9897  (1) 

PLNBSL3  0.0477  0.8918  0.05(0) 

P-  0.30 

SET  SPLNBSL3  P-0. 82196(1)  m 

PLMBSL31  0.2084  0.8139  (1) 

PLNBSL33  0.0030  0.7483  (1) 

PLNBSL33-0.1034  0.9648  (1) 


J-10 


srr  sraizsKs 

DOMYl  0.1500 
ooMtyi  0.0000 
DOMMYl  -0.1368 

srr  SPTIIISK3 

I>(MHY4  0.00S8 
DOMfYS  0.3376 
OtaMy6  -0.1423 

SIT  SPLC08iC3 
DDMCrr  -0.1887 
OONMy8  0 . 0772 
OOMTS  -0.0119 

SIT  SPSRISKl 
DOMYIO  0.1220 
DOMYll  -0.1020 
OaMiyi2  -0.1476 

SIT  SPTIIISK4 
DTMiy22  0.1887 
DCMflni  -0.0460 
OaiMy24  -0.2810 
DDIMy2S  0.3376 
D(]8My26  -0.1786 

SIT  SPSRISIC3 
Oa»My27  0.1645 
ODM(T28  0.2088 
DC8My29  -0.1485 
DDMfTlO  -0.1386 
DDMMTSl  -0.0798 
MPTRISKl  0.3141 
MPTRISK2- 0.1141 
MPTR1SIC3-0.0714 
MPTRISK4- 0.1555 
MNOICPSl  0.0862 
MtlOSCPS2  0.1373 
KNOSCPS3  0.3940 
MliOICPS4  0.4073 
MNOSCPS5  0.2896 
MNOSCPS6  0.3381 
MPSRISIU-0.2083 
MPSRISIC3-0.1741 
MPRISCMl-0.0536 
MPRISCH2-0.1633 
NPRISCH4- 0.1074 
HPRISC3I6  0.2434 
NPLAOGR  0.2455 
MSOfIRC  0.3640 
NPLC0NC3- 0.0178 
MSONSIMT  0.3745 
mVSZIlT  0.1396 


F- 

0.25 

P-0. 

78042(1) 

0.8484 

(1) 

1.0000 

(1) 

0.9529 

(1) 

P- 

0.92 

P-0. 

.45114 (1) 

0.8111 

(1) 

0.8376 

(1) 

0.9811 

(1) 

P- 

0.27 

P-0. 

.84348(1) 

0.8572 

(1) 

0.8965 

(1) 

0.9573 

(1) 

P- 

0.39 

P-0. 

.76289(1) 

0 . 8614 

(1) 

0.8913 

(1) 

0.9548 

(1) 

P- 

1.04 

P-0. 

.42850(1) 

0.9512 

(1) 

0.9008 

(1) 

0.8618 

(1) 

0.8376 

(1) 

0.9944 

(1) 

P- 

0.37 

P-0 

.86437(1) 

0.9401 

(1) 

0.9711 

(1) 

0.9119 

(1) 

0.9897 

(1) 

0.9251 

(1) 

0.9803 

2.30(1) 

0.8930 

0.28(0) 

0.9904 

0.11(0) 

0.9773 

0.52(0) 

0.9444 

0.16(1) 

0.9172 

0.40(1) 

0.9837 

3.86(1) 

0.9525 

4.18(1) 

0.9692 

1.92 (1) 

0.9752 

2.71(1) 

0.8386 

0.95(0) 

0.9886 

0.66(0) 

0.9665 

0.06(1) 

0.7302 

0.58(1) 

0.8743 

0.25(1) 

0.9919 

1.32(1) 

0.8421 

1.35(1) 

0.5325 

3.21(1) 

0.9879 

0.01(0) 

0.4745 

3.43(1) 

0.9811 

0.42(1) 

snr  NO. 


3 


VMUABLI  INRiUD) 


9  NOBCPS 


MOLTZPU  R  0.73-71 
MDLTZPLI  R-SQORRI  0.5434 
ADJUSTID  R-SQORRI  0.4781 


STD.  niOR  or  1ST. 


59.1013 


AHRLYSZS  or  VARZANCI 


SOM  or  SQOARBS 

or 

NIAH  SQOARE 

r  RATIO 

RBQRBSSZOH 

87384.055 

3 

39094. C9 

8.33 

RBSZOOAL 

73353.148 

31 

3493.959 

VARIABLES  ZM  EQaATZOM 


VAHTABUS  HOT  ZN  EQaATZaH 


vARZABLi  coirr. 


(CQHSTANT  133.5373) 
NOBCPS  1.1903 
SONSOZSP  -75.3071 
MPRBSCH3  -75.8331 


STD.IRR 

or  coirr  tol. 

r  AND  P 

RmOVI(L) 

PARTIAL 

VARIABLE  CORR.  TOL. 

r  AMD  P 
BMTBR(L) 

0.5210 

0.9878 

5.03(1) 

CTYPE  -0.0753 

0.8924 

0.11(1) 

3S.33C9 

0.9993 

8.15(1) 

PLACOt  0.3107 

0.9284 

2.14(1) 

33.9575 

0.9879 

10.03(1) 

PLC08K;  0.1600 

0.8024 

0.53(1) 

PAOBSSON-0.3908 

0.9820 

3.61(1) 

N(X>ZDS  -0.0347 

0.9170 

0.02(1) 

PLDRRTP  -0.1938 

0.8535 

0.77(1) 

S0MC8SR  -0.0629 

0.9283 

0.08(1) 

SONRCBP  0.3826 

0.5313 

3.43(1) 

SONPRSZ  0.0094 

0.9396 

0.00(1) 

NOPMDZDS  0.2336 

0.9491 

1.04(1) 

NOIVCRZT  0.0434 

0.9448 

0.04(1) 

BVRCMP  -0.2333 

0.9794 

1.15(1) 

EVRCBP  -0.0319 

0.9677 

0.02(1) 

OCOSTCD  -0.2192 

0.8248 

1.01(1) 

D  OP  -0.0866 

0.8701 

0.15(1) 

m(»)OPT  0 . 1966 

0.8751 

0.80(1) 

PLPRBSCH-0.2075 

0.6605 

0.90(1) 

PLNBSDBV- 0.1350 

0.6568 

0.37(1) 

S0HDMB8  -0.0857 

0.8568 

0.15(1) 

SONRCNP  0.2075 

0.5794 

0.90(1) 

BVSDZSP  0.2250 

0.7553 

1.07(1) 

PLSRZSK  -0.1623 

0.9926 

0.54(0) 

F> 

0.28 

SET  5PLSRZSK 

P>0 

.76032(1) 

PLSRZSKl-0.0279 

0.8637 

(1) 

PLSRZSK2-0.1405 

0.9810 

(1) 

PLTRZSK  -0.1209 

0.9398 

0.30(0) 

r- 

1.42 

SET  SPLTRZSK 

P-O 

.26621(1) 

PLTRZSKl  0.3597 

0.4159 

(1) 

PLTR1SK3- 0.1972 

0.9451 

(1) 

COMPLEX  -0.2319 

0.8152 

1.14(0) 

r- 

0.86 

SET  SCOMPLBX 

P>0 

.43992(1) 

COMPLEXl-0.1701 

0.9475 

(1) 

C0MPLBZ2-0.0838 

0.9043 

(1) 

TBCHDEm  0.1250 

0.9105 

0.32(0) 

r- 

1.27 

SET  STBCHDEP 

P-O 

.31355(1) 

TECHDBPl-0.3303 

0.8087 

(1) 

TBCHDEPS  0.3528 

0.9189 

(1) 

TBCBDBP3-0.0215 

0.8883 

(1) 

PLNB8L3  -0.0123 

0.8759 

0.00(0) 

r- 

0.06 

SET  SPLNBSL3 

P-O 

.98045(1) 

PLNBSL31-0.0028 

0.6269 

(1) 

PLNBSL32  0.0708 

0.7344 

(1) 

PLHBSL33-0.0877 

0.9620 

(1) 

J-12 


P- 

0.39 

SIT  SraiISK2 

P-0. 

.67968(1) 

DOMYl  O.llSl 

0.8401 

(1) 

DOMKTS  0.0000 

1.0000 

(1) 

DOMTS  •0.X972 

0.9451 

(1) 

P> 

2.13 

SIT  SPTKISU 

P«0. 

.13196(1) 

nMHy4  -0.020C 

0.8086 

(1) 

DOMflrS  0.4S07 

0.8159 

(1) 

DOMTS  -0.2141 

0.9690 

(1) 

P- 

0.58 

SIT  SPLC0HC3 

P>0. 

.63778(1) 

oamtrj  -o.isss 

0.8478 

(1) 

OtMiyS  0.1S4S 

0.8624 

(1) 

DOMTS  0.1SS3 

0.8548 

(1) 

fm 

0.33 

SIT  SPSRISXl 

9m0 

.80410(1) 

DOMMYIO  0.0488 

0.8336 

(1) 

OCMCril  -0.0279 

0.8637 

(1) 

Da»Myi2  -0.1609 

0.9547 

(1) 

P- 

2.24 

SIT  SPT11ISK4 

P-0 

.10021(1) 

OaMMy22  0.2982 

0.9233 

(1) 

0(Mty23  -0.0340 

0.8996 

(1) 

DaMiy24  -0.3023 

0.8614 

(1) 

DCMiy2S  0.4607 

0.8159 

(1) 

DaHHy26  -0.2398 

0.9877 

(1) 

P- 

0.53 

SIT  SPSRISIC3 

P-0 

.75264(1) 

DaiMy27  0.0644 

0.8828 

(1) 

D(IMy28  0.2926 

0.9574 

(1) 

Ot»My29  -0.1081 

0.8990 

(1) 

Ot»My30  -0.1193 

0.9845 

(1) 

DaMy31  -0.2246 

0.8619 

(1) 

MPTRISKl-0.1714 

0.2197 

0.61(1) 

MPTR1SK2-0.1988 

0.8748 

0.82(0) 

HPTIUSIU- 0.1324 

0.9791 

0.36(0) 

NPTRISK4- 0.1844 

0.9768 

0.70(0) 

NMOICPSl  0.1994 

0.9055 

0.83(1) 

NHOBCPS2- 0.1376 

0.6419 

0.39(1) 

MNOBCPS3- 0.0180 

0.1660 

0.01(1) 

MliOBCPS4  0.0758 

0.2744 

0.12(1) 

miOBCPS5-0.2779 

0.1788 

1.67(1) 

MMOBCPS6-0.2937 

0.0906 

1.89(1) 

MPSRISKl-0.2113 

0.8371 

0.93 (0) 

MPSRISIC3-0.38S4 

0.9573 

1.77(0) 

MPRBSCHl  0.1549 

0.8035 

0.49(1) 

HPRISCB2- 0.0541 

0.6789 

0.06(1) 

KPRBSCH4-0.0949 

0.8721 

0.18(1) 

NPRBSCH6  0.3635 

0.9607 

3.05(1) 

MPLM»R  0.1323 

0.7659 

0.36(1) 

MSOWRC  0.3826 

0.5313 

3.43(1) 

KP1.CONC3  0.2069 

0.8105 

0.89(0) 

NSONSIirr  0.4597 

0.4711 

5.36(1) 

Mivsiirr  0 . 1800 

0.9787 

0.67(1) 
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STIP  MO. 


4 


VMIXMU  BRIItlD  CC  MSOMSUiT 

NOLTZPLI  R  0 . 7999 

MDLTZPLI  R-SQURRS  0.C399 

ADJOSTB)  R-SQORRI  0.5478 

STD.  IRROR  or  BST.  53.7816 

AMRLYSZS  or  VRRIAHCB 

SOM  or  sooRRis  or  mum  SQoauuc  r  ratio 

RMORMSSZOai  102787.08  4  25696.77  8.88 

RISZOCBUi  57849.129  20  2892.457 


VRRZABIiU  ZM  MOaRTZaal  VRRTABLM  MOT  ZM  IQaMTZaH 


STD. UR 

P  AMO  P 

PARTIAL 

F  AMD  P 

VRRZABZ.S 

comrr. 

OP  COCPP 

TOL.  RB«0VI(L) 

VARZASLI  (»RR. 

TOL.  DmOKL) 

(COMSTAMT  150.0834) 

MOICPS  1.2848  0.4849  0.9806  7.02(1)  CTTPR  0.0264  0.8517  0.01(1) 

SOWSDZSP  -120.2996  30.8829  0.6017  15.17(1)  PlAOCBl  0.2518  0.8916  1.29(1) 

MPRSSCH3  -109.6435  26.2429  0.6818  17.46(1)  PUXRIC  0.0414  0.7434  0.03(1) 

NSONSZNT  73.0910  31.5711  0.4711  5.36(1)  PJkOSSSOM-0.3914  0.9726  3.44(1) 

MmZDS  -0.1631  0.8681  0.52(1) 

PLDRRTP  -0.2784  0.8422  1.60(1) 

SOMCSSR  0.0818  0.8513  0.13(1) 

SONRCBP  0.0239  0.1871  0.01(1) 

SOWPRSZ  0.0141  0.9395  0.00(1) 

MOPMDZOS  0.0380  0.7836  0.03(1) 

NOIVCRZT- 0.1198  0.8515  0.28(1) 

BVRCNP  -0.3452  0.9569  2.57(1) 

BVRCBP  -0.0631  0.9650  0.08(1) 

OCOSTCS  -0.2455  0.8248  1.22(1) 

O  OP  -0.0173  0.8491  0.01(1) 

SnODOfT  0.0013  0.7166  0.00(1) 

PLPRSSCH  0.0497  0.4732  0.05(1) 

PLMBSDIV- 0.0875  0.6464  0.15(1) 

SONDNBS  0.0122  0.8192  0.00(1) 

SONRCMP  -0.0497  0.4151  0.05(1) 

RVSOZSP  0.1167  0.6993  0.26(1) 

PLSRZSK  -0.0953  0.9634  0.17(0) 

r-  0.12 

SET  SPI.SRZSK  P-0.88545  (1) 

PLSR1SIC1-0.0S58  0.8618  (1) 

PLSR1SIC2-0.0702  0.9519  (1) 

PLTRZSK  -0.1659  0.9367  0.54(0) 

P-  0.79 

SBT  SPLTRZSK  P-0. 46945(1) 

PLTRZSKl  0.2692  0.3825  (1) 

PLTRZSX2-0.2131  0.9448  (1) 

COHPLSX  -0.2900  0.8127  1.74(0) 

r-  1.20 

SIT  SCOMPLBC  P-0. 32552(1) 

COMPLm-0.1820  0.9471  (1) 

CaMPLIX2-0.1230  0.9016  (1) 

TSCRDIPN  0.1235  0.9095  0.29(0) 

r-  1.16 

SIT  SnCHDir  P-0. 35457(1) 

TICSDRn-0.3225  0.8008  (1) 

TKaDIP2  0.3481  0.9101  (1) 

TICBDSP3-0.0215  0.8883  (1) 

PLNBSZJ  -0.0891  0.8578  0.15(0) 

P-  0.02 

SIT  SPLNBSL3  P-0. 99582(1) 

PLNBSL3 1-0. 0196  0.6262  (1)  » 

PLNBSL32  0.0328  0.7283  (1) 

PLMBSL33-0.0442  0.9512  (1) 
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SIT  SPTIIISK2 
DOMYl  0.1792 
D0Miy2  0.0000 
DOMiyS  -0.2131 

SIT  SPTRISU 
OCMmr4  0.0742 
DCMNYS  0.4399 
mSMTS  -0.2111 

SIT  SPLCGtiC3 
DCNMyr  -0.0048 
Dowra  0.1312 
DOMYS  -0.03S4 

SIT  SPSRISXI 
DOMTIO  0.0438 
DtlMyil  -0.0S58 
Daiwyi2  0.0303 

SIT  SPTItISK4 
Da»wy22  0.1948 
DtMnni  -0.0111 
DDIMY24  -0.2747 
DOinnS  0.4399 
Da«Y2(  -0.2169 

SIT  SPSRISK3 
DaMY27  0.0593 
OtMflnS  0.3680 
DDMfy29  -0.1116 
DOMnnO  -0.1426 
DDMMTSl  -0.2201 
MPTRlSKl-0.2034 
NPTIUS1C2-0.1980 
MPTRISK3- 0.1040 
MPTIIISK4- 0.1654 
MHOICPSl  0.0889 
M(K>8CPS2- 0.1799 
KtK>8CPS3-0.0238 
MN08CPS4  0.1253 
MIiO8CPS5-0.2033 
NIK18CPS6- 0.2220 
NPSRISKl  0.0250 
MPSRISK3-0.2830 
MPRISCMl  0.2106 
MPRISCH2  0.0706 
NPRISCH4-0.0133 
MPRSSai6  0.3044 
NPIAOCai  0.0715 
MSONRC  0.0239 
MPLC0IIC3  0.0209 
mVSINT  0.1178 


P- 

0.44 

P>0. 

64948(1) 

0.8339 

(1) 

1.0000 

(1) 

0.9448 

(1) 

P> 

1.60 

P-0. 

.22559(1) 

0.7807 

(1) 

0.7939 

(1) 

0.9657 

(1) 

P- 

0.10 

P-0. 

.95908(1) 

0.7507 

(1) 

0.8427 

(1) 

0.7165 

(1) 

P- 

0.04 

P-0. 

.99088(1) 

0.8332 

(1) 

0.8618 

(1) 

0.7992 

(1) 

P- 

1.56 

P-0 

.23053 (1) 

0.8487 

(1) 

0.8972 

(1) 

0.8465 

(1) 

0.7939 

(1) 

0.9768 

(1) 

P- 

0.66 

P-0 

.65829(1) 

0.8822 

(1) 

0.9524 

(1) 

0.8987 

(1) 

0.9843 

(1) 

0.8583 

(1) 

0.2196 

0.82(1) 

0.8726 

0.78(0) 

0.9715 

0.21(0) 

0.9701 

0.53(0) 

0.8403 

0.15(1) 

0.6404 

0.64(1) 

0.1660 

0.01(1) 

0.2728 

0.30(1) 

0.1700 

0.82(1) 

0.0862 

0.98(1) 

0.6267 

0.01(0) 

0.9518 

1.65(0) 

0.7997 

0.88(1) 

0.6366 

0.10(1) 

0.8435 

0.00(1) 

0.9156 

1.94(1) 

0.7484 

0.10(1) 

0.1871 

0.01(1) 

0.6721 

0.01(0) 

0.9514 

0.27(1) 
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STEP  NO.  5 

VARIABLE  EimRBD  16 

PAOBSSOH 

NOLTZPLB  R 

0.8337 

MDLTZPLB  R-SQOAU 

0.6950 

ADJOSTED  R-SOaARB 

0.6148 

STD.  EiUUNt  OP  EST. 

50.7763 

ANALYSIS  OP  VARIANCE 

STBI  OP  SQOARBS 

DP 

MIAN  SQUARE 

P  RATIO 

A 

RBQRBSSI08I 

111649.82 

5 

22329.96 

8.66 

RBSIOOAL 

48986.390 

19 

2578.231 

VARIABLES  IN  B(3aATZ0H 

VARIABLES  HOT 

IN  EQUATION 

VJttlABLB 

COBPP. 

STD. ERR 

OP  COBPP  TOL. 

F  AMD  P 
REMOVE (L) 

VARIABLE 

PARTIAL  F 

CORR.  TOL. 

AMD  P 
BNTBR(L) 

(CONSTANT 

192.3236) 

PAOBSSOH 

-1.0697 

0.5769 

0.9726 

3.44(1) 

CTYPE 

0.0241 

0.8517 

0.01(1) 

NOBCPS 

1.310S 

0.4580 

0.9797 

8.19(1) 

PLAOCai 

0.1648 

0.8264 

0.50(1) 

SONSDISP  - 

122.1006 

29.1733 

0.6011 

17.52(1) 

PLCONC 

0.1889 

0.6693 

0.67(1) 

MPRBSCH3  - 

105.4565 

24.0792 

0.6762 

17.97(1) 

NOOIDS  - 

0.0416 

0.7769 

0.03 (1) 

MSONSINT 

67.6666 

29.9502 

0.4666 

5.10(1) 

PLDRRPP  - 

0.3777 

0.8193 

3.00(1) 

SONCSSR 

0.0846 

0.8512 

0.13(1) 

SOHRCBP 

0.1423 

0.1743 

0.37(1) 

SOWFRSI 

0.1040 

0.9007 

0.20(1) 

MOPMDIDS 

0.1160 

0.7605 

0.25(1) 

NOEVCRIT- 

0.0761 

0.8374 

0.10(1) 

EVRCHP  - 

0.2729 

0.8908 

1.45(1) 

EVRCBP  - 

0.1763 

0.9090 

0.58(1) 

OCOSTCD  - 

0.2391 

0.8212 

1.09(1) 

0  OP 

0.0920 

0.7946 

0.15(1) 

raODOPT 

0.1424 

0.6457 

0.37(1) 

PLPRBSCH 

0.0569 

0.4732 

0.0*;  (1) 

PLNBSDEV- 

0.0036 

0.6165 

0.00(1) 

SONDNBS 

0.0907 

0.7931 

0.15(1) 

SONRCNP  • 

0.0569 

0.4151 

0.06 (1) 

EVSDISP 

0.0849 

0.6923 

0.13(1) 

PLSRISK  -0.0194 

0.9253 

0.01(0) 

F- 

0.05 

SET  SPLSRISK  P.O. 95347(1) 

PLSRISlU-0.0699  0.8614  (1) 

PLSRISK2  0.0044  0.9178  (1) 

PLTRISK  -0.1866  0.9365  0.65(0) 

F-  0.31 

SET  SPLTRISX  P-0. 73646(1) 

P1.TRZSIU  0.0497  0.2476  (1) 

PLTRISia- 0.1797  0.9300  (1) 

COMPLEX  -0.2911  0.8100  1.67(0) 

F-  0.86 

SET  SCOMPLBX  P-0.44173 (1) 

COMPLBXl-0.0701  0.8679  (1) 

CX3MPLEX2-0.1893  0.8870  (1) 

TECMDEFN  0.2845  0.8172  1.59(0) 

F-  2.80 

SET  STECHDEF  P-0.07342 (1) 

TECHDEFl-0.4163  0.7841  (1) 

TECHDEF2  0.4805  0.8683  (1) 

TECHDEF3  0.0488  0.8632  (1) 

PLNBSL3  0.1145  0.6716  0.24(0) 

F-  0.29 

SET  SPLHBSL3  P-0.02956 (1) 

PLH8SL31-0.1446  0.5784  (1) 

PLMBSL32  0.0342  0.7283  (1) 

PLNBSL33  0.1759  0.7352  (1) 


J-16 


SIT  SPTltlSKS 
DOMYl  0.2083 

ocaMva  0.0000 
ooMnra  -0.1797 

SIT  SPTRISK3 
OOWY*  0.1466 
OtSMYS  0.3638 
DOMTS  -0.1813 

SIT  SPLCQIIC3 

ooann  0.0928 
OaMMy8  0.1868 
0(Miy9  0 . 0244 

SIT  SPSRISKl 
DOMNYIO  0.0076 
DtMiyil  -0.0699 
DDIMyi2  0.0765 

SIT  SPTRISK4 
DaMKY22  0.1849 
DDIMy23  0.0296 
D0NMy24  -0.3796 
DOMMy2S  0.3638 
DOMHy26  -0.1637 

SIT  SPSRISIC3 
ODIWY27  -0.0418 
OaMKy28  0.2384 
Dai«Y29  -0.1514 
DOMMTSO  0.0831 
DOMtTll  -0.2708 
MPTRISKl- 0.1234 
MPTRISIC2- 0.1477 
MPTRISK3-0.0695 
MPTRISK4-0.1338 
MHOICPSl  0.1625 
MNOSCPS2-0.3150 
MHOICPSl -0.0241 
MHOSCPS4  0.3222 
MMOECPS5-0.2849 
KNOECPS6-0.3080 
MPSRISKl  0.0657 
MPSRISK3- 0.2165 
MPRBSCHl  0.3238 
MPRSSCH2-0.0440 
MPRSSCH4  0.0402 
MPRESCH6  0.2916 
MPLMSOR  0.0105 
MSONRC  0 . 1423 
MPLCCWCS  0.1345 
MIVSIMT  0.0670 


F> 

0.40 

P>0. 

67574(1) 

0.8331 

(1) 

1.0000 

(1) 

0.9300 

(1) 

P> 

0.97 

P>0  . 

43248(1) 

0.7629 

(1) 

0.7173 

(1) 

0.9527 

(1) 

P> 

0.32 

P>0. 

.80807(1) 

0.7127 

(1) 

0.8340 

(1) 

0.7004 

(1) 

F- 

0.05 

P.O. 

.98457(1) 

0.8258 

(1) 

0.8614 

(1) 

0.7910 

(1) 

F» 

1.24 

P>0 

.34052 (1) 

0.8447 

(1) 

0.8886 

(1) 

0.8201 

(1) 

0.7173 

(1) 

0.9468 

(1) 

F- 

0.42 

P>0 

.82737(1) 

0.8286 

(1) 

0.7717 

(1) 

0.8943 

(1) 

0.7077 

(1) 

0.8538 

(1) 

0.2072 

0.28(1) 

0.8493 

0.40(0) 

0.9612 

0.09(0) 

0.9584 

0.33(0) 

0.8212 

0.49(1) 

0.5984 

1.98(1) 

0.1660 

0.01(1) 

0.2334 

2.08(1) 

0.1665 

1.59(1) 

0.0842 

1.89(1) 

0.6216 

0.08(0) 

0.9026 

0.89(0) 

(1.7655 

2.11(1) 

0.5868 

0.03 (1) 

0.8297 

0.03 (1) 

0.9073 

1.67(1) 

0.7297 

0.00(1) 

0.1743 

0.37(1) 

0.6292 

0..’3(0) 

0.9313 

0.08(1) 

J-17 


STEP  tiO.  S 


VMtZABLB  nmuo  SET  STECHDEP 

40  TECHDEPl 

41  TECHDEPl 

42  TECHDEP3 

MDbTIPUt  R  0.8945 

MULTIPLE  R-SQUARE  0.8001 

ADJUSTED  R-S0IARE  0.7001 

STD.  ERROR  OP  EST.  44.8034 

ANALYSIS  OP  VARIANCE 

SUM  OP  SQUARES  OP  MEAN  SQUARE  P  RATIO 

RBQRESSIOII  138518.75  8  1C0S4.S4  8.00 

RESIDUAL  33117.459  16  2007.341 

VARIABLES  IN  EQUATIOH  VARIABLES  MOT  IN  EQUATION 

STD. ERR  P  AMD  P  PARTIAL  P  AND  P 

VARIABLE  COEPP.  OP  COEPP  TOL.  REMOVE(L)  VARIABLE  CORE.  TOL.  BMTBR(L) 


(CONSTANT  170.4494) 

PAOESSON  -1.5378  0.5461  0.8451  7.93(1)  CTYPE  -0.0361  0.6191  0.01(1) 

NOECPS  1.6159  0.4433  0.8184  13.35(1)  PLAGOR  0.0963  0.7518  0.14(1) 

SOHSOISP  -99.5787  36.9474  0.5485  13.66(1)  PLCOHC  0.1180  0.5831  0.21(1) 

P>  2.80 

SET  STECHDEP  P-0.07342 (1) 

TECHDEPl  -30.3465  39.3100.5124  (1)  MODIDS  -0 . 1513  0 . 7187 (0 . 563 ) (1) 

TBCHDEP3  60.1653  29.9998  0.4891  (1) 

TBCHDEP3  35.3843  27.4169  0.4909  (1) 

MPRBSCH3  -100.7516  23.7969  0.6370  19.53(1)  PLDRRPP  -0.1718  0.6478  0.46(1) 

MSOHSIMT  56.0962  26.7382  0.4561  4.40(1)  SOWCSSR  0.1366  0.6918  0.24(1) 

SONRCBP  0.3116  0.1369  0.70(1) 

SOWPRSI  0.3920  0.7904  1.40(1) 

NOFMDIOS  0.1857  0.7387  0.54(1) 

MOEVCRZT- 0.1262  0.6935  0.24(1) 

EVRCNP  -0.4499  0.7914  3.81(1) 

EVRCBP  0.1158  0.5616  0.20(1) 

UCOSTCS  -0.0373  0.5013  0.01(1) 

0  DP  0.1737  0.5676  0.46(1) 

PRODOPT  0.1703  0.5726  0.45(1) 

PLPRESCH- 0.1926  0.4056  0.58(1) 

PLNBSDEV- 0.1436  0.5581  0.32(1) 

SONDMBS  0.1385  0.7683  0.29(1) 

SO^CNP  0.1926  0.3558  0.58(1) 

BVSDISP  0.2865  0.6073  1.34(1) 

PLSRISK  0.1181  0.8248  0.21(0) 

P-  0.17 

SET  SPLSRISK  P-0. 84586(1) 

PLSRZSKl  0.0611  0.7030  (1) 

PLSRZSIC3  0.0860  0.8918  (1) 

PLTRISX  -0.3043  0.8959  1.53(0) 

P-  0.77 

SET  SPLTRISK  P-0.48214 (1) 

PLTRISXl  0.0820  0.1906  (!' 

PLTR1SX2-0.3893  0.9038  (1) 

COMPLEX  0.0195  0.3791  0.01(0) 

P-  0.01 

SET  SCCMPLEX  P-0.98794 (1)  » 

COMPLSZl-0.0378  0.7879  (1) 

C0MPLEZ2  0.0394  0.5710  (1) 

TECHDEPN  0.0000  1.0000  0.00(0) 

PLNBSL3  -0.3239  0.5043  0.79(0) 

P-  0.39 

SET  SPLMBSL3  P-0. 76161(1)  • 

PLMBSL31  0.0351  0.5191  (1) 

PLNBSL32  0.2233  0.5433  (1) 

PLHBSL33-0.2394  0.3924  (1) 


J-18 


SKT  SPT1USK2 
DQMMYl  0.2279 
Da(MY2  0 . 0000 
DaMY3  -0.2893 

SBT  SPTI11SK3 
DtMfy4  0.2662 
OOMNYS  0.2263 
OOM«y6  -0.1961 

SKT  SPtiC0MC3 
DQMrn  -0.1620 
DCMfTS  0.2233 
DDMfy9  0.07S5 

SBT  SPSRISKl 
DOMYIO  -0.1910 
DOMMyil  0.0611 
DaiWY12  0.0087 

SBT  SPTRISK4 
DtMfy22  0.1940 
OCMfy23  0 . 1242 
DDIMy24  -0.2280 
DDMNY25  0.2263 
OaMMY26  -0.1888 

SBT  SPSRISIC3 
DtMHY27  -0.1214 
DaM(y28  0.2247 
DtMtYRS  -0.006S 
DOtMTlO  0.0881 
DOMMYSl  -0.0871 
MPTRISK1-0.289S 
MPTRlSIt2-0.2773 
MPTRISK3 -0.0868 
MPTRISK4- 0.1477 
KNOBCPSl  0.1615 
NMOBCPS2-0.1231 
MNOBCPS3  0.0796 
MNOBCPS4  0.0375 
MNOECPS5-0.1647 
MNOBCPS6- 0.0563 
MPSRISKl-0.0271 
MPSRISK3  0.0336 
MPRBSCHl  0.1808 
HPRBSCH2- 0.0533 
MPRBSCH4-0.3435 
MPRBSC3<6  0.1833 
MPLAGGR  0.0028 
MSOHRC  0.2116 
MPLCaMC3  0.1498 
M8VSZMT  0.2542 


P- 

0.64 

P>0. 

54117(1) 

0.8007 

(1) 

1.0000 

(1) 

0.9038 

(1) 

F- 

0.53 

P«0. 

66773 (1) 

0.7301 

(1) 

0.6139 

(1) 

0.8981 

(1) 

P- 

0.47 

P-0. 

70686(1) 

0.6100 

(1) 

0.7033 

(1) 

0.6949 

(1) 

P> 

0.29 

P-0. 

.83495(1) 

0.7258 

(1) 

0.7020 

(1) 

0.7766 

(1) 

P- 

0.47 

P-0 

.78891(1) 

0.7938 

(1) 

0.8323 

(1) 

0.5849 

(1) 

0.6139 

(1) 

0.9173 

(1) 

P- 

0.19 

P-0 

.96048(1) 

0.6158 

(1) 

0.7462 

(1) 

0.7502 

(1) 

0.6796 

(1) 

0.6631 

(1) 

0.1984 

1.37(1) 

0.8139 

1.25(0) 

0.9187 

0.11(0) 

0.9501 

0.33 (0) 

0.6732 

0.40(1) 

0.4977 

0.23 (1) 

0.1607 

0.10(1) 

0.0708 

0.02(1) 

0.1100 

0.42 (1) 

0.0429 

0.05(1) 

0.5822 

0.01(0) 

0.5844 

0.02 (0) 

0.6442 

0.51(1) 

0.5812 

0.04 (1) 

0.5681 

2.01(1) 

0.7193 

0.52(1) 

0.6941 

0.00(1) 

0.1369 

0.70(1) 

0.5876 

0.34 (0) 

0.8011 

1.04 (1) 

STSP  MO. 
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VMUABLl  IMTBIUD  32  KVRCNP 

MOLTXPLB  R  0.91Se 

NOLTIPLB  R-SOOMIB  0.8405 

ADJDSTB)  R-SOOMIB  0.7448 

STD.  KRROR  OF  BST.  41.3252 

AMMiYSIS  or  V3UUJUICB 

SOM  or  SOOARBS  or  NBAH  SQOARR  F  RATIO 

RaORISSIOH  135019.59  9  15002.18  8.78 

RISIOOAL  25C16.611  15  1707.774 

VARIABLES  IH  BQOATION  VARIABLES  HOT  IN  BQOATKXI 

STO.BRR  r  AMO  P  PARTIAL  P  AMD  P 

VARIABLE  COEFF.  OF  COEFF  TOL.  REMOVE  (L)  VARIABLE  CCMtR.  TOL.  ENTER  (L) 


(COMSTAMT  197.8800) 
PAGESSOM  -1.3618 
EVRCNP  -45.3175 
MOECPS  1.6305 

SONSOISP  -106.9714 

SET  STECHDEF 
TECRDEFl  -18.8461 
TBCHDEF2  66.0045 
TBCHDEF3  40.6531 
MPRE8CR3  -107.0308 
MSONSIMT  64.5499 


0.5118  0.8188  7.08(1)  CTYPE  0.0528  0.6030  0.04(1) 

23.2272  0.7914  3.81(1)  PLAGCR  0.1960  0.7303  0.56(1) 

0.4079  0.8181  15.97(1)  PLOBIC  0.2923  0.5332  1.31(1) 

25.1426  0.5360  18.10(1)  MOOIDS  -0.1501  0.7177  0.32(1) 

F-  3.85 
P«0. 03167(1) 

27.0460.5120  (1)  PLORRFP  0.0121  0 .5421 (0 . 964) (1) 

27.8322  0.4835  (1) 

26.4869  0.4475  (1) 

21.2720  0.6127  25.32(1)  SOHCSSR  0.2757  0.6490  1.15(1) 

25.0311  0.4425  6.65(1)  SOMRCSP  0.1035  0.1267  0.15(1) 

SONFRSI  0.3844  0.7809  2.43(1) 

NOPMDIDS  0.4083  0.6496  2.80(1) 

NOEVCRXT-0.0278  0.6579  0.01(1) 

EVRCBP  0.5921  0.3295  7.56(1) 

□COSTCO  -0.0455  0.5008  0.03(1) 

D  DP  0.0905  0.5430  0.12(1) 

maoovi  0.0336  0.5158  0.02(1) 

PLPRESCH- 0.1695  0.4021  0.41(1) 

PLHBSDBV-0.0333  0.5218  0.02(1) 

SOHDNBS  0.15270.7683  0.33(1) 

SOHRCWP  0.1695  0.3527  0.41(1) 

EVSDISP  0.4428  0.5777  3.41(1) 

PLSRISK  0.2416  0.7895  0.87(0) 

F>  0.86 

SET  SPLSRXSK  P>0. 44728(1) 

PLSRISKl  0.1492  0.6848  (1) 

PLSRISIC2  0.1664  0.8753  (1) 

PLTRXSK  -0.1752  0.7859  0.44(0) 

F-  0.21 

SET  SPLTRISK  P>0. 81629(1) 

PLTRISKl  0.0872  0.1906  (1) 

PLTRISX2-0.1723  0.8119  (1) 

COMPLEX  0.1123  0.3673  0.18(0) 

F-  0.09 

SET  SCOMPLBX  P-0. 91328(1) 

COMPLEXl- 0.0421  0.7879  (1) 

C0HPLBX2  0.1056  0.5627  (1) 

TECRDEFM  0.0000  1.0000  0.00(0) 

PLMBSL3  -0.1994  0.4989  0.58(0) 

F-  0.55 

SET  SPLHBSL3  P-0.65524 (1) 

PLHBSL31  0.1872  0.4727  (1) 

PLNBSL32  0.2073  0.5393  (1) 

PLNB8L33-0.2614  0.3923  (1) 

F-  0.23 

SET  SPTR1SK2  P-0. 80042(1) 

DDIMYl  0.1701  0.7764  (1) 

DDMM)r2  0.0000  1.0000  (1) 

DDMHYl  -0.1723  0.8119  (1) 


J-20 


F> 

0.51 

SBT  <18X3 

P.O 

.68503(1) 

DCMMY* 

0.1166 

0.6363 

(1) 

OOMYS 

0.330a 

0.6009 

(1) 

DVt&as 

-0.0876 

0.8333 

(1) 

P> 

0.87 

SBT  SPLOBICa 

P-0 

.48148(1) 

DOMIYT 

-0.1171 

0.5997 

(1) 

DCMiya 

o.asio 

0.7033 

(1) 

DOMTS 

o.aoi3 

0.6607 

(1) 

r- 

0.45 

SBT  SPSRZSXl 

P-O. 

.73335(1) 

DOMTIO 

-0.a716 

0.7168 

(1) 

DCMCni 

0.149a 

0.6848 

(1) 

DCMNYia 

0.0345 

0 . 7747 

(1) 

P- 

0.58 

SBT  SPTIIZSK4 

P-0. 

.71366(1) 

Downa 

0.1184 

0.7618 

(1) 

DOMyas 

o.iaao 

0.8365 

(1) 

Dt]iwy24 

-0.1181 

0.5385 

(1) 

ooMms 

0.330a 

0.6009 

(1) 

OOMMYaS 

-0.1361 

0.8899 

(1) 

P- 

0.39 

SBT  SP8RISK3 

P-0. 

.90743(1) 

DOtMYa? 

-0.1630 

0.6141 

(1) 

DOMMYaS 

0.1303 

0.6930 

(1) 

DOMMYaS 

0.0847 

0.7359 

(1) 

OOMUYSO 

0.0614 

0.6758 

(1) 

D0MMY31 

0.0916 

0.5758 

(1) 

HPTRISKl 

-0.0934 

0.1535 

0.13(1) 

Mpnusxa' 

•0.1517 

0.7339 

0.33 (0) 

MPTKISK3 

0.0315 

0.8683 

0.01(0) 

MPTRZSK4 

-0.0306 

0.8809 

0.01(0) 

MHOBCPSl 

0.3990 

0.6406 

1.37(1) 

MMOBCPSa 

0.0743 

0.4148 

0.08(1) 

MNOECPSa 

0.3354 

0.1503 

0.75(1) 

MNOBCPS4 

0.0035 

0.0704 

0.00(1) 

KBOBCPSS 

-0.1335 

0.1083 

0,31(1) 

MNOBCPS6 

0.13^1 

0.0373 

0.33(1) 

MPSRZSKl 

0.03UU 

0.5739 

0.01(0) 

MPSRZSK3 

0.3151 

0.5313 

0.68(0) 

MPRBSCHl 

0.3596 

0.5937 

2.08(1) 

NPRBSCH2 

0.0355 

0.5647 

0.01(1) 

MPRBSCH4 

0.0357 

0.3095 

0.01(1) 

MPRBSCaiS 

0.3769 

0.6534 

2.32(1) 

NPLAGGR 

0.0646 

0.6839 

0.06(1) 

Msotmc 

0.1035 

0.1367 

0.15(1) 

KPLCCNC3 

0.3175 

0.5437 

1.57(0) 

HBVSZHT 

0.6137 

0.6063 

8.42(1) 

J-21 
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VMUABUI  mnRID  S7  MIVSIMT 

MOLTZPUt  R  0.9489 

MOLTIPUI  R-SgOMtB  0.9004 

AOJDSTB)  R-SQOMtR  0 . 8293 

STD.  BSROR  OP  BST.  33.80S7 

MOLYSZS  OP  VHRZMICS 

SUM  OP  SQCDUtCS  OP  MIMI  SQQMU  P  RATZO 

RIOtBSSZON  14463C.63  10  144S3.6S  13.66  r 

RISZOORL  15999.589  14  1142.828 

VRRZABZ.I8  ZM  IQaKTZaN  VMtZABLRS  HOT  ZH  BQaATZCH 


STD.SRR  P  AMD  P  PARTZAL  P  AMD  P 

VARZABLB  COBPP.  OP  COSPP  TOL.  RBIOVB(L)  VARZABLB  CCMIR.  TOL.  BMTBR(I.) 


(COKSTAMT  189.8637) 

PAOBSSON  -1.0515  0.4331  0.7686  5.92(1)  CTYPR  0.1906  0.5882  0.49(1) 

BVRCMP  -76.5564  21.8402  0.5990  12.39(1)  PUOGR  0.0614  0.6871  0.05(1) 

MOBCPS  1.6438  0.3337  0.8180  24.23(1)  PLCOMC  0.1262  0.4776  0.21(1) 

SOWSDZSP  -99.2888  20.7375  0.5273  33.93(1)  MOOZDS  0.0545  0.6479  0.04(1) 

P-  7.76 

SBT  STB(SDBP  P-0. 00370(1) 

TBCHDBPl  -38.5685  22.3770.5005  (1)  PLDRRPP  -0 .1666  0 . 5137 (0 . 553) (1) 

TBCHDKP3  78.5696  23.1763  0.4666  (1) 

TBCHDBP3  36.4333  21.7163  0.4455  (1) 

MPRBSCH3  -113.7526  17.5138  0.6049  41.45(1)  SONCSSR  0.3753  0.6483  2.13(1) 

MSONSZMT  56.8129  20.6495  0.4351  7.57(1)  SOHRCBP  0.1556  0.1266  0.32(1) 

MBVSZMT  50.7437  17.4922  0.6063  8.43(1)  SONPRSZ  0.1486  0.6179  0.29(1) 

NOPMDZDS  0.3065  0.5959  1.35(1) 

NOBVCRZT- 0.0586  0.6573  0.04(1) 

KVSLCB9  0.4191  0.2480  2.77(1) 

OCOSTCS  -0.3063  0.4551  1.35(1) 

D  DP  0.0549  0.5398  0.04il) 

PRODOPT  -0.1329  0.4904  0.23(1)  ' 

PLPRBSC31-0.2639  0.4005  0.97(1) 

PLHBSDBV- 0.0835  0.5303  0.09(1) 

SOMDNBS  -0.1142  0.6543  0.17(1) 

SOHRCMP  0.2639  0.3513  0.97(1) 

BVSDZSP  -0.2700  0.1253  1.02(1) 

PLSRZ8K  0.0154  0.6779  0.00(0) 

P-  0.60 

SBT  SPLSRZSK  P-0. 56580(1) 

PLSRZSXl  0.3814  0.6754  (1) 

PLSRZSK2-0.0735  0.7618  (1) 

PLTRZSK  -0.1640  0.7814  0.36(0) 

P-  1.84 

SBT  SPLTRZSX  P-0.20084 (1) 

PL.TRZSK1  0.4610  0.1598  (1) 

PLTRZSK2-0.2213  0.8119  (1) 

COMPLEX  -0.0779  0.3386  0.08(0) 

P«  0.38 

SBT  SCOMPLBX  P-0.68918 (1) 

COMPLBXl  0.2292  0.6935  (1) 

CaMPLBX2- 0.2213  0.4586  (1) 

TBCHDBPM  O.OOO'O  1.0000  0.00(0) 

PLNBSL3  -0.0132  0.4511  0.00(0) 

P-  0.03 

SBT  SPLNBSL3  P-0. 99405(1) 

PLMB8L31  0.0359  0.4405  (1) 

PLNBSL32-0.0611  0.4485  (1) 

PLHBSL33  0.0598  0.2967  (1) 

P-0.32  * 

SBT  SPTRZSK2  P-0.73443 (1) 

DDMMYl  0.1870  0.7753  (1) 

DUMMY!  0.0000  1.0000  (1) 

D(n<MY3  -0.3213  0.8119  (1) 
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SR  SPTIlISn 
DaMMy4  0 . 0797 
DOMYS  0.1236 
DOMiye  •0.1853 

SR  SPLCOHCa 
DOMflr;  0.0370 
OOMYS  0.1157 
01MIY9  0.0354 

SR  SPSRISKI 
DOMfYlO  -0.1365 
OCMIYll  0.3814 
OaMNY13  -0.2394 

SR  SmiSKt 
D0IMY32  0.0813 
DnWY33  0.0606 
DaMIY24  0.4503 
DtaMY25  0 . 1236 
DaiMY26  -0.1843 

SR  SPSRIS1C3 
DtM(Y27  -0.0992 
DOIMYSS  0.0262 
DDM(Y29  0.3248 
DaMMY30  0.1328 
DaMMY31  -0.3224 
MPTRISKl-0.2197 
MPTIIZSK3-0.2064 
MPTRISIC3- 0.1699 
MPTIUSK4- 0.1201 
MHOBCPSl  0.3605 
M1(OBCPS2-0.1300 
KtlOBCPS3 -0.4564 
iaiOBCPS4  0.2954 
MIIOBCPS5-0.44S1 
MIIOBCPS6-0 . 1772 
MPSRISKl-0.2179 
MPSRISK3- 0.0916 
MPRESCSl  0.1616 
MPRBSCH2-0.2036 
MPRBSCH4- 0.1038 
MPRESCH6  0.3086 
MPLAGCat  0.0136 
MSONRC  0 . 1556 
MPLCONC3  0.1042 


F- 

0.21 

P-0 

.88956(1) 

0.6214 

(1) 

0.5085 

(1) 

0.8258 

(1) 

F- 

0.11 

P-0, 

.95398(1) 

0.5693 

(1) 

0.6536 

(1) 

0.6071 

(1) 

F- 

0.69 

P-0. 

.57777(1) 

0.6578 

(1) 

0.6754 

(1) 

0.6819 

(1) 

F- 

0.55 

P-0. 

.73834(1) 

0.7557 

(1) 

0.7863 

(1) 

0.3183 

(1) 

0.5085 

(1) 

0.8890 

(1) 

F- 

0.43 

P-0. 

.81554(1) 

0.6025 

(1) 

0.6736 

(1) 

0.6747 

(1) 

0.672S 

(1) 

0.4274 

(1) 

0.1500 

0.66(1) 

0.7237 

0.58(0) 

0.8152 

0.39(0) 

0.8714 

0.19(0) 

0.6402 

1.94(1) 

0.3817 

0.22(1) 

0.0647 

3.42(1) 

0.0616 

1.24(1) 

0.0957 

3.21(1) 

0.0309 

0.42(1) 

0.5167 

0.65(0) 

0.4128 

0.11(0) 

0.5000 

0.35(1) 

0.5163 

0.56(1) 

0.2032 

0.14(1) 

0.6186 

1.37(1) 

0.6786 

0.00(1) 

0 . 1266 

0.33(1) 

0.4590 

0.14(0) 

HOTB  THAT  VMtIABLB  37  PLTRZSX2  CMIHOT  BB  BRBRBD 
BBCA0SB  IT  DID  NOT  PASS  THB  TOLBRANCB  TBR. 


MOTB  THAT  SR  MNOBCPS3  NHICH  HAS  THB  SMALLEST  P-VALDB 
IN  THB  PRBVIODS  STEP,  CANNOT  BB  BNTBRBD. 


NOTE  THAT  VARIABLE  52  MNOBCPS3  CANNOT  BB  BNTBRBD  BBCADSB  ITS  ENTRY 

NOOLD  LONER  THB  TOLERANCE  OF  VARIABLE  9  NOBCPS  BELOW  THB  TOLBRANCB  LIMIT. 


snp  MO. 
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VARIABLE  IRTMRBD  SBT  SPLTRISK 
36  PLTRZSKl 


MOLTIPLI  R  0.9600 
NOLTZPLB  R-SOaARB  0.9216 
AOjnSTBD  R-SQDARB  0.8552 

STD.  ERROR  OP  EST.  31.1318 


AtOLYSIS  OP  VARZAMCE 

SOM  OP  SQOARES  DP  KEAH  SQDARE  P  RATIO 
REORESSZOII  148036.  11  13457.89  13.89 
RESZDOAL  12599.434  13  969.1872 


Hotat  DM  to  th«  aemlatioB  problM*  ld«BtlCl«d  at  Etap  Mo.  8,  tba  raatalalag  atapa  wara 
raaavad  froai  tba  output  raport. 


SDMMARY  TABLE 


STEP 

VARIABLE 

MOLTIPLE 

CHANGE 

P-VALOE 

P-VALDE 

NO. OP  VAR 

NO. 

ENTERED 

REMOVED 

R 

RSQ 

IN  RSQ 

ENTER 

REMOVE 

IMCLDDRD 

1 

60 

MPRBSCH3 

0.4996 

0.2496 

0.2496 

0.01 

1 

2 

25 

SOWSOISP 

0.6589 

0.4341 

0.1845 

0.01 

2 

3 

9 

MOBCPS 

0.7371 

0.5434 

0.1093 

0.04 

3 

4 

66 

MSONSINT 

0.7999 

0.6399 

0.0965 

0.03 

4 

5 

16 

PAOESSOH 

0.8337 

0.6950 

0.0552 

0.08 

5 

6 

SET 

STBCHDBF 

0.8945 

0.8001 

0.1050 

0.07 

8 

40 

TECHDEPl 

41 

TECHDBF2 

42 

TBCKDEP3 

7 

32 

BVRCHP 

0.9168 

0.8405 

0.0405 

0.07 

9 

8 

67 

MSVSINT 

0.9489 

0.9004 

0.0599 

0.01 

10 

9 

SBT 

SPLTRISK 

0.9600 

0.9216 

0.0212 

0.08 

11 

36 

PLTRISKl 

10 

16  PAOESSOH 

0.9606 

0.9228 

0.0012 

0.68 

10 

11 

25  SONSOZSP 

0.9601 

0.9218- 

-0.0009 

0.70 

9 

12 

24 

SONCSSR 

0.9840 

0.9683 

0.0465 

0.00 

10 

13 

59 

MPRBSCH2 

0.9890 

0.9781 

0.0098 

0.04 

11 

SERIAL  CORRELATION  -0.1802 

OORBIM-NATSOM  STATISTIC  2.3121  BASED  ON  25  CASES 
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w  o  H  O  O  O 


CASE  PLOTS 
CASE  LABEL 


RESZDOALS 

STRESID 


LEVERACE 

-LOO  P(H) 


INPLOENCE 

MODCOOK 


NO. 

-4  -2  0 

2 

4 

0 

1 

2 

3 

4 

0  1 

2 

3 

4 

S 

6 

+  .  .  .  .  + _ ♦ _ 

♦  .  .  . 

.  .♦ 

.  ♦  . 

.  + 

1 

* 

** 

• 

2- 

N 

N 

N 

3 

*••• 

♦  ** 

«*• 

4- 

N 

H 

M 

5 

*««• 

«•«* 

C 

»•** 

7 

* 

* 

8 

* 

*« 

9 

•  • 

****8 

«• 

10- 

M 

M 

H 

11 

* 

**•* 

* 

12 

13 

• 

♦ 

14 

* 

*• 

IS 

* 

«# 

* 

16 

•  * 

« 

*« 

17 

* 

18- 

M 

M 

M 

19 

** 

»«*« 

*• 

20 

«**« 

* 

21 

•  «* 

**#* 

*«*# 

22 

» 

•  * 

**** 

23 

****4 

r*** 

*♦*« 

24 

r*«« 

*** 

25 

« 

26 

r** 

**« 

* 

27 

28 

* 

*«* 

#<* 

29 

* 

*** 

.4. . 

♦  .  . 

.  .+ 

+  .  .  .  . 

♦  .  ♦ 

.  ,  +  .  . 

.  .♦ 

+  .  .  +  . 

.•f  . 

.+ 

-4  -2  0 

2 

4 

0 

1 

2 

3 

4 

0  1 

2 

3 

4 

5 

6 

.  + . + . . + . ♦ . ♦ . + . +  . 


.2  -I- 


-  1  2  1 

0.  +  112 

.♦ . + . ♦ .  .  .  . 

3. 

0.  6. 


11  1  1 

. . .  .  . 


12 

OCOSTCD 
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BXTRINB  CASKS  -- 

CASK  NO.  COOK  CASS  NO.  OCOSTCD 

3  0.7321  17  2S.73S4 

6  0.4973  25  20.7504 


BXnUMB  CASKS  IN  THS  PLOTS  -- 

KXTRSm  CASK  2  24 

STATISTICS  VALOS  NO.  LABSL  NSIOiiT  SCHSDPSR  SONCSSR 


COOK 

0.7321  3 

1.0000  -10. 

.0000 

COOK 

0.4973  6 

1.0000  13. 

.0000 

CASK 

32 

9 

36 

37 

NO.  LABSL 

KVRCNP 

NOSCP8 

PLTRISKI 

PLTIUSK2 

3 

1.0000 

8.0000 

0.0000 

1.0000 

6 

1.0000 

25.0000 

1.0000 

0.0000 

CASS 

40 

41 

42 

59 

NQ.  LABKL 

TKCHDSPl 

TKCHDKP2 

TSCHDSP3 

NPR88CH2 

3 

0.0000 

1.0000 

0.0000 

1.0000 

6 

1.0000 

0.0000 

0.0000 

1.0000 

CASS 

60 

66 

67 

NO.  LABKL 

MPRSSCHl 

MSONSINT 

MSVSINT 

3 

1.0000 

1.0000 

0.0000 

6 

1.0000 

0.0000 

0.0000 

17 

1.0000 

0.0000 

1.0000 

25 

0.0000 

0.0000 

1.0000 

1 


.  + . + . . ♦ . ♦ . + . ♦. 

50.  150  250 

0.0  100  200  300 


PRSDICTD 


O  H  >  M  ><  H  M  O  K  h  B(  O  X  H  M  A  H  U  H  M  D  SO 


*.  .  .H 


♦ 


-  *  • 

-.4  ♦  + 


. . . .4 . . 

.  .  . 

,lr¥,  . 

.  .4*.  .  .  , 

...... 

-25 

-IS 

-5. 

5. 

15 

25 

-30 

-20 

o 

rt 

0. 

10 

20 

VALDES 

FROM 

NORMAL  DISTRIBUTIOI 

W0DU> 

LIS 

ON  TRI  LINE  INDICATED  BY  THE  SYMBOL  - 
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K; _ BMDP  2R  Steowiae  Reareasion  on  SCaiEDMOD.  Full  Variable  Set. 

Intaraction  Tarma  Included  ( Edited  Data  Output) 

PROGRAM  IMSTRtXn:iOMS 

/IHPtTT  FZLB-'TfnSIS.ASC'  . 

VMUABLBS-33 . 

POMXT-FRn. 


/VARZABU  NANBS-CIIO,  SOHDPIR.  SOOCMOO,  SCHIDPLR,  tlCX)STCD,  CTTPB, 

o_op,  moDon,  nobcps,  plprksch.  plachr,  plconc,  plsrzsk, 

PLTRZSK,  CCWPLIX,  PAGISSON,  MODZDS.  PLNBSDKV,  PLNBSL3,  PLNB8LL, 
PLDRRPP.  TBCBOlPH,  S0NDMB8,  SOHCSSR,  SOMSDZSP,  SONRCNP, 

SOMRCBP,  SOWfRSZ,  MOPMDZDS.  MOIVCRZT,  IVSDZSP,  BVRCNP,  BVRCBP. 


aSB-8CMBDM(»,  CTYPR,  PLAOOR.  PLCOHC.  PAOBSSOH,  MGOZOS,  PLDRRPP, 
SOWCSSR,  SOMRCBP,  SONFRSZ,  MOPMDZDS,  IK>BVCRZT,  BVRCtV,  BVRCBP, 
OCOSTCD,  D_DP,  PRODOPT.  HOBCPS,  PLPRBSCH,  PLHBSDBV,  SONDNBS, 
SOMSDZSP,  SOMRCMP,  BVSOZSP.  PLSRZSK,  PLSRZSKl,  PLSRZSK2,  PLTRZSK, 
PLTRZSKl,  PLTRZSK3,  COMPLBX,  CCMPLBXl,  CCMPLBX2,  TBCHDBFN,  TSCMDBFl, 
TBCHDBFS,  TBCHDBF3.  PLMBSL3,  PLMBSL31,  PLMBSL32,  PLNBSL33,  DOMfYl, 
DOMfln,  DOMira,  D(B«nr4,  DOMiyS,  DCMMYS,  dummy?,  DOMMYS,  D0MMY9, 
DUIMYIO.  DUMMYll,  DCRMYIS,  OUIMY23,  D0IMY23,  DOIMY24,  DDMMY2S, 
DtBMY26.  DUMMY27,  DUMflnS,  Dt»WY29.  DOM(Y30,  DUMIY31,  MPTRZSKl, 
MPTRZSX2,  NPTRZSK3,  MPTRZSK4.  MHOBCPSl,  MM08CPS2,  MMOBCPS3, 

MM0BCPS4,  MMOBCPSS,  MNOBCPS6,  MPSRZSKl,  MPSRZSK3,  MPRBSCHl, 

MPRBSCH2,  MPRBSCH3,  MPRBSCH4,  MPRBSCH6,  MPLAOGR,  NSONRC,  MPLC0NC3, 
MSOMSZMT,  MEVSZHT.  • 

/TRANSFORM  ZF  (PLSRZSK  BQ  1)  lliBN(PLSRZSXZ«0.  PLSRZSK2>iO . )  . 

ZF(PLSRZSK  BQ  2)  THBN(PLSRZSK1>1.  PLSRZSK2.0 . ) . 

ZF (PLSRZSK  BQ  3)  THBN(PLSRZSK1«0 .  PLSRZSK2>1 . ) . 


ZF (PLTRZSK  BQ  1) 
ZF (PLTRZSK  BQ  2) 
ZF (PLTRZSK  BQ  3) 


THBN(PLTRZSKl-0. 

TKBN(PLTRISX2>1. 

THBN(PLTRZSKl-0. 


PLTRZSK2-0 . ) . 
PLTRZSX2-0.} . 
PLTRZSK2-1.)  . 


ZF (COMPLEX  BQ  Z) 
ZF(COMPI<BX  BQ  2) 
ZF(COHPLBX  BQ  3) 


TBBM(COHPLBX1-0 .  COMPLBX2-0 . ) . 
THBN(CaMPLEXl-l.  cbNPLBX2>0 . ) . 
THEN (COMPLBXl-0 .  C0MPLBX2>1 . ) . 


ZF(TECHDBFN  BQ  1)  THBN(TBCKDBF1>0 .  TBCaiDEF2>0.  TECHDBF3 -0  . )  . 
ZF(TBCHDBFN  BQ  2)  THBN(TECHDEF1>1.  TEC3!DBF2>0.  TBCHDEF3>0 . )  . 
ZF (TBCHDBFN  BQ  3)  THBN(TBCHDEF1>0 .  TBCHDEF2>1.  TECHDBF3-0 . ) . 
ZF(TBCHDBFN  BQ  4)  THEN(TECHDEFl-0.  TECKDBF2-0.  TBCHDBF3>1 . ) . 


ZF(PLNBSL3  BQ  0)  THBN(PLHBSL31>0.  PLHBSL32>0.  PLNBSL33>0 . ) . 

ZF(PLNBSL3  ST  0  AND  PLNBSL3  LB  10)  THEN(PLHBSL31>1.  PLNBSL32-0.  PLWBSL33-0 . ) . 
ZF(PLMBSL3  CTT  10  AMD  PLMBSL3  LB  16)  THBN(PLNBSL31>0 .  PLHBSL32-1.  PLHBSL3 3 >0 . )  . 
ZF(PLNB8L3  ST  16)  THBN(PLNBSL31<0.  PLHBSL32-0.  PLNBSL33>1 . ) . 


MPTRZSK1-PLTRZSK*N0BCPS . 
MPTRZSK2-PLTRZSK*PLNBSDBV 
MPTRZSK3-PLTRZSK*80NDNBS . 
NPTRZSK4-PLTRZSK*PLSRZSK. 
MHOBCPS1«NOBCPS*PLCOHC . 
MNOBCPS2>MOBCPS*PLDRRFP . 
MNOBCPS3>MOBCPS*BVSDZSP . 

t  MNOBCPS4-MOBCP8*TBCHDBFM. 

MM0BCPS5>N0BCPS*UC0STCD . 
MNOBCPS6-MOBCPS*COMPLEX . 
MPSRZSK1-PLSRZSK*PLPRB8CH 
MP8RZSK3 -PLSRZSK*COMPLBX . 
MPRBSCH1-PLPR8SCM*PLC(»IC . 
«.  MPRBSCH2-PLPRBSCH*PLDRRFP. 

NPRBSCH3-PLPRBSCH*SONRCNP 
MPRBSCH4 -PLPR8SCH*EVRCMP . 
MPLASQR>PLASSR*SOHSDZSP . 
MSOHRC-SaWRCBP*SOHRCMP . 
MPLCOMC3 -PLCONC* PLSRZSK . 
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MntBSCH6>PLPUSCH*PLM3Glt*PLCailC . 
MSONSDIT-SOI«DISP*SONRCMP*SOiaiCBP . 
NIVSniT-BVSOISP*BVI(CNP*BVRCBP . 


/CROUP 


IF(MPTRISK2 

EQ 

0) 

THBM(D0M(Yl-0. 

DDMIY2-0. 

DDMNY3-0.)  . 

IF(MPTRISK3 

Vi 

1) 

THENCDOMMYl-l. 

OaMHY2-0 . 

DaMIY3-0.)  . 

IF(MPTRISK2 

BQ 

2) 

THBM(DOIMY1-0. 

DDMHY2-1. 

DaW(Y3-0 . )  . 

IF(MPTRISX2 

■Q 

3) 

TRBH(DDIMYl-0. 

D0MIY2-0. 

D0M(Y3-1.)  . 

IF(MPTRISX3 

■Q 

0) 

TRIM(DCBBfY4-0. 

O0M(YS-0 . 

DDMfY6-0.)  . 

IF(MPTRZSK3 

IQ 

1) 

THBM(ODMfY4-l. 

DMIYS-O. 

DOMIYC-0 . )  . 

IF(MPTRISX3 

IQ 

2) 

THEM(O0MtY4-0. 

DDMIYS-l. 

DOMMYS-O . )  . 

IF(MPTRISX3 

IQ 

3) 

Q 

1 

1 

1 

DOMMYS-O. 

DOMIY6-1.)  . 

IF(MPLOOaK3 

IQ 

0) 

THBM(D0MKY7-0. 

DDMMYS-O. 

ODMIY9-0 . )  . 

IF(MPLC0HC3 

IQ 

1) 

THEN(OOIMY7-1. 

DOMMYS-O. 

D0NfY9-0.)  . 

IF(MPLCCHiC3 

IQ 

2) 

THBM(IXaMY7-0. 

DDMOfS-l. 

D0MIY9-0.)  . 

IF(MPLC0IIC3 

IQ 

3) 

THBM(OOMIY7-0. 

DDIMYS-O . 

D0MfY9-l . )  . 

IF(MPSRISK1 

IQ 

0) 

THBH(O0MMY10-0 

.  DOMMYll- 

0.  D0IMY12-0. 

)  - 

IF(NPSRXSX1 

IQ 

1) 

THBH(D0MMY10-1. 

.  DOMlYll- 

D.  1NBMY12-0. 

)  . 

IF(MPSRISK1 

IQ 

2) 

THBM(DDMMY10-0 

.  DOMYll- 

1.  DOIBIY12-0. 

)  . 

IF<MPSRISK1 

IQ 

3) 

THEM (DDMMYIO-O 

.  DDMMYll- 

0.  D0MMY12-1. 

)  . 

IF(MPTRISK4 

IQ 

1) 

TKBM(D0MfY32-0 

.  D0MIY23- 

0.  DaMMY24-0. 

DDMMY25-0 . 

D0M(Y26-0 . ) 

IF(NPTRXSK4 

IQ 

2) 

THEM(D(»HY23-1 

.  DDMfY23- 

D.  DOIMY24-0. 

D0IMY25-0 . 

DOM<Y26-0 . ) 

IF(MPTR1SK4 

IQ 

3) 

TREM(DDM(Y32-0 

.  D0M(Y23- 

1.  D0MIY24-0. 

DOIMY25-0 . 

O0MIY26-0  . ) 

IF(MPTRISK4 

IQ 

4) 

THBH(DaMMY22-0. 

.  DaMY23- 

0.  D0IMY24-1. 

DU»B(Y25-0. 

D0MfY26-0 . ) 

IF(MPTRISK4 

IQ 

6) 

THBN(DDIMY22-*b 

.  D0MMY23- 

0.  D0MMY24-0. 

DOMMY2S-1 . 

DOIB4Y26-0  . ) 

IF(MPTRISK4 

IQ 

9) 

THBM(DUIMY22-0 

.  DDMMY23- 

0.  DOMMY24-0. 

DOMMY2S-0 . 

DIBMY26-1.) 

IF(MPSRISK3 

BQ 

1) 

THBN(D0MMY37-0 

.  DOMHY28-0.  OOIBIY29-0 . 

D0MMY30-0. 

DDMMy31-0. ) 

IF(MPSRISK3 

BQ 

2) 

THBM(DaM(Y27-l 

.  OaMMY28- 

0.  DaiMY29-0. 

DaMMY30-0. 

DUMMY! 1-0. ) 

IF(MPSRISK3 

BQ 

3) 

THBN(DOMMY27-0 

.  DaMMY28- 

1.  DaMMY29-0. 

DOMMY30-0. 

DUMMY! 1-0. ) 

IF(MPSR1SX3 

BQ 

4) 

THBN(DaMMY27-0 

.  DUM<Y28- 

0.  ODMMY29-1. 

DUMfYSO-O. 

DWMY31-0.) 

IF(MPSRISK3 

BQ 

«) 

THKN(OimMY27-0 

.  DDMMY28-0.  DUMMY29-0. 

DOMMY30-1. 

DUMMY! 1-0.) 

IF(MPSRISK3 

BQ 

9) 

THEN(DUIMY27-0. 

.  DUIMY28- 

0.  D0IMY29-0. 

DDMMY30-0. 

DUMMY! 1-1. > 

CODES (D_DP, 

PRODOPT,  PLPRESCH,  PLNBSDEV,  PLDRRFP,  SOHDNBS, 

SOWSOISP,  SOHRCHP,  EVSDISP,  CTYPB,  PLAGOR,  PLCONC,  SOWCSSR, 
SONRCBP,  SONFRSI,  BVRCWP,  EVRCBP.  PLSRISKl,  PLSRISIC2, 

PLTRISKl,  PLTRISK2,  COMPLSXl,  C0HFLBX2,  PUIBSL31,  PLWBSL32, 
PLWBSL33,  TBCRDBFl,  TBCHOEF2,  TBCKDEF3,  MPRBSCBl,  MPRBSC3i2, 
MPRESCH3,  MPRBSCH4,  MPLAGGR,  MSOMRC,  MSOWSIBT,  MEVSIMT, 
MPilBSC316,  DUMMYl,  OUMMy2,  DUMMY3,  DUWnr4.  DUNMYS,  DOWfYe, 
Dinonn,  DUMKYS,  OUHHYS,  OUMCYIO,  DU»B(Y11,  DUMMY12,  DOMNy22, 
DOimY23,  DUMMY24,  OaM(Y25,  OaMMY2S,  OOMMy27,  DCMMY28,  OOMMY29, 
DUMinr30,  DOMHy31)-l,  0. 


* 


iaMSS(0  DP,  PRODOPT,  PLPRESCH,  PLNBSDEV,  PLDRRFP,  SOWDNBS, 
SONSDISP,  SOHRCHP,  EVSDISP,  CTYPB,  PLAGOR,  PLCONC,  SOHCSSR, 
SOHRCBP,  SOHFRSI,  BVRCHP,  BVRCBP,  PLSRISKl,  PLSRISK2, 

PLTRISKl,  PLTR1SK2,  COMPLBXl,  CONPLEXl,  PLHB8L31,  PLHBSL32, 
PLHBSL33,  TBCHDBFl,  TBCHDBF2,  TECHDBF3,  MPRBSCHl,  MPRBSCH2, 
MPRBSCH3,  HPRBSCH4,  MPLAGGR,  MSOHRC,  MSOHSIMT,  MEVSIMT, 
MPRBSCM6,  DUlWYl,  DUM(Y2,  DUMMY3,  DDM(Y4,  DDIMYS,  DD»MY6, 
DDMHY?,  DDIMYS,  DDIMY9,  OOMMYIO,  DIMMYll,  DDMMY12,  DDMMY22, 
DDMMY23,  DDtMY24,  DUMMY25,  DUMNY26,  DUMMY27,  D0IMY28,  DUMMY29, 
DUMMY30,  DUMMY31)-YBS,  NO. 

CWBSCPLSRISK,  PLTRISK,  COMPLEX)-!,  2,  3. 

NAMBS (PLSRISK,  PLTRISK) -LON,  LOW  MED,  OTHER. 

NAMES (COMPLEX) -LON,  MED,  HI. 


CODES (TBCHDBFH)-l,  2,  3,  4. 

NAMBS (TBCHDBFM) -DRAFT_A,  FULL_A,  DRAFT_B,  FULL_B. 
C(X>BS(PLHBSL3)-1,  2,  3,  4. 

NAMBS (PLHBSL3)-'UNDBR_2',  '2_11',  '11_17',  'OVBR_17’ . 


K-2 


/ttaatMSS  DtPtKDmscasaiOD. 

SirmiOtS-SPLSRISK,  SPLTRISK.  SCOMPLSX.  STBOlDBr,  SPLNBSL3, 
SPTltZSK2,  SPmiSlU,  SPLC0HC3.  SPSRISKl,  SPTRISK4,  SPSRISIC3 . 
SPI.SRZSIUPLSIIZSIU.,  PI^ISKS. 

SPLTRZSK-PLTItlSia,  PLTKZSK2 . 

SCXWPUQC-CONPLBXl,  C0MPLBX3 . 

STBatDIF-TiaiDBPl,  TBCHDBP3.  TBCKDBP3 . 

SPLIiBSL3-PLHBSL31,  PLHBSUS.  PLHBSL33. 

8PTRZSlC2-0(»Dfyi,  OOMfiTS.  OOMTrZ . 

SPTRZS1C3-ODIWY4,  OOMIYS.  OOMNyS. 

8PLC0NC3-O(B«y7,  OOMfiTS.  OOMtirS. 

8P8BZ8ici-o{»wn.o,  ooMnni,  ooMcris. 

8PTIlZ8K4>Dtl«nr32,  OOMmZ,  DCMNya4,  DDMflrSS,  DDMIYSfi. 
8P8KZSIC3>0Qlwy27,  OOMmS.  0(BMy39.  OCMflrZO,  DtMKyzl. 

ZMPVBL-O.l,  0.1. 

OOTPVBl^O.ll,  0.11. 

ZBOBPBHD-CTYPB,  PUhQQR.  PLCOtiC.  PAaBS80N,  tlOOID8,  PUffiltFP, 
80IK:88R,  SOWRCBP,  SONFRSZ,  1I0PMDID8.  NOBVCRZT,  BVRCWP, 

BVRCSP.  0C08TCD,  0  OP,  PRODOPT,  ItOBCPS,  PLPRBSCH,  PLNB8DBV, 
80NDNBS,  S0H8OZSP,~S0NRCMP,  BVSOZSP,  8PLSRZSK,  SPLTRZSK, 

SCCMPLBX,  STBCHDBP,  SPLWBSL3.  SPTRZSia,  SPTR1S1C3,  SPLC0MC3, 
SP8RZ8K1,  SPTRZSK4,  SPSRZSX3,  HPTRZ8K1,  MH0BCP81,  MtlOBCPS2, 
MIIOBCPS3,  MNOBCP84,  MHOBCPSS,  MMOBCPS6,  HPRBSCHl,  MPRBSCH2, 
MPRB8C313,  NPRB8CH4,  MPLAO(»,  MSONRC,  MPRB8C116,  NSOHSZMT,  MBVSIHT. 
TOL-0.1. 

/PRINT  LBVBL-MZNZHAL. 

HO  DATA. 

HO  CORR. 

STBP. 

AHOVA. 

NO  COVA. 

NO  PART. 

NO  COBF. 

NO  FRAT. 

HO  RRBO. 

CASB-0 . 

LZNBSZZB-80. 

/PLOT  RBSZOOALS. 

DNORHAL. 

SZZ8-60,  25. 

CAS8PL0TS. 

XVAR-OCOSTO). 

YVAR-COOX. 

8TBP«ALL. 

NO  DATA. 

/BHD 


NIMBBR  OF  CA8BS  RBAD .  29 

CASBS  NZTH  DATA  MZ88ZHG  OR  BBYOMD  LIMITS  .  .  6 

RBMAZNZNQ  NOMBBR  OF  CASBS .  23 


OISCRIPTZVB  STATISTICS  OF  DATA 


VARIABLE  TOTAL 

STANDARD 

SKBH- 

SMALLEST 

LARGEST 

NO. 

NAMB 

FRK}. 

MBAN 

DBV. 

NBSS  KDRTOSIS 

VALUE  Z-SCR 

VALUB 

Z-SCR 

3 

SCHBDHOD 

23 

50.965 

45.414 

0.460 

-0.842 

-27.900  -1.74 

139.70 

1.95 

6 

CTTPB 

23 

.39130 

.49901 

0.417 

-1.904 

0.0000  -0.78 

1.0000 

1.22 

11 

Fuuxai 

23 

.21739 

.42174 

1.282 

-0.367 

0.0000  -0.52 

1.0000 

1.86 

12 

PLcatnc 

23 

.43478 

.50687 

0.246 

-2.022 

0.0000  -0.86 

1.0000 

1.12 

IS 

PAOBSSOM 

23 

40.783 

17.789 

0.885 

-0.004 

17.000  -1.34 

87.000 

2.60 

17 

NODIOS 

23 

61.478 

20.956 

-0.048 

-1.028 

25.000  -1.74 

100.00 

1.84 

21 

PLORRFP 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

24 

SONCSSR 

23 

.43478 

.50687 

0.246 

-2.022 

0.0000  -0.86 

1.0000 

1.12 

27 

SONRCBP 

23 

.65217 

.48698 

-0.598 

-1.711 

0.0000  -1.34 

1.0000 

0.71 

28 

SONFRSI 

23 

.86957 

.34435 

-2.053 

2.322 

0.0000  -2.53 

1.0000 

0.38 

29 

NOPMDIDS 

23 

7.4783 

2.3716 

-0.003 

-0.845 

3.0000  -1.89 

12.000 

1.91 

30 

NOBVCRIT 

23 

4.0000 

2.5226 

1.398 

1.273 

1.0000  -1.19 

11.000 

2.77 

32 

BVRCNP 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

33 

BVRCBP 

23 

.65217 

.48698 

-0.598 

-1.711 

0.0000  -1.34 

1.0000 

0.71 

S 

OCOSTCD 

23 

9.7290 

7.1877 

0.473 

-0.864 

.18103  -1.33 

25.738 

2.23 

7 

D  DP 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

8 

PRODOPT 

23 

.56522 

.50687 

-0.246 

-2.022 

0.0000  -1.12 

1.0000 

0.86 

9 

tK>BCPS 

23 

28.696 

23.688 

1.437 

1.311 

5.0000  -1.00 

95.000 

2.80 

10 

PLPRBSCH 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

18 

PLMBSDBV 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.  ...3 

1.0000 

0.45 

23 

SOMDMBS 

23 

.82609 

.38755 

-1.610 

0.624 

0.0000  -2.13 

1.0000 

0.45 

25 

SOWSOISP 

23 

.78261 

.42174 

-1.282 

-0.367 

0.0000  -1.86 

1.0000 

0.52 

26 

SOHRCHP 

23 

.78261 

.42174 

-1.282 

-0.367 

0.0000  -1.86 

1.0000 

0.52 

31 

BVSDISP 

23 

.56522 

.50687 

-0.246 

-2.022 

0.0000  -1.12 

1.7000 

0.86 

13 

PLSRISK 

23 

2.2609 

.91539 

-0.501 

-1.663 

1.0000  -1.38 

3.0000 

0.81 

34 

PLSRISKI 

23 

.13043 

.34435 

2.053 

2.322 

0.0000  -0.38 

1.0000 

2.53 

35 

PLSRISK2 

23 

.56522 

.50687 

-0.246 

-2.022 

0.0000  -1.12 

1.0000 

o.ae 

14 

PLTRISK 

23 

2 . 1304 

.96786 

-0.245 

-1.932 

1.0000  -1.17 

3.0000 

0.90 

36 

PLTRISKl 

23 

.08696 

.28810 

2.743 

5.779 

0.0000  -0.30 

1.0000 

3.17 

37 

PLTRISIQ 

23 

.52174 

.51075 

-0.081 

-2.078 

0.0000  -1.02 

1.0000 

0.94 

15 

COMPLEX 

23 

2.0435 

.70571 

-0.053 

-1.080 

1.0000  -1.48 

3.0000 

1.36 

38 

COMPLEXl 

23 

.52174 

.51075 

-0.081 

-2.078 

0.0000  -1.02 

1.0000 

0.94 

39 

C0MPLEX2 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

22 

TBCHDBFN 

23 

2.6522 

1.1912 

-0.115 

-1.601 

1.0000  -1.39 

4.0000 

1.13 

40 

TBCHDEFl 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

41 

TECHDEF2 

23 

.17391 

.38755 

1.610 

0.624 

0.0000  -0.45 

1.0000 

2.13 

42 

TECHOBF3 

23 

.34783 

.48698 

0.598 

-1.711 

0.0000  -0.71 

1.0000 

1.34 

19 

PLWBSL3 

23 

13.957 

16.291 

1.992 

3.866 

0.0000  -0.86 

70.000 

3.44 

43 

PLHBSL31 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

44 

PLNBSL32 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

45 

PLHBSL33 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

68 

DDMMYl 

23 

.30435 

.47047 

0.796 

-1.423 

0.0000  -0.65 

1.0000 

1.48 

69 

00HHY2 

23 

0.0000 

0.0000 

0.0000 

0.0000 

70 

DOMKT3 

23 

.52174 

.51075 

-0.081 

-2.078 

0.0000  -1.02 

1.0000 

0.94 

71 

0aMMT4 

23 

.34783 

.48698 

0.598 

-1.711 

0.0000  -0.71 

1.0000 

1.34 

72 

DIBMYS 

23 

0.0000 

0.0000 

0.0000 

0.0000 

73 

Domys 

23 

.47826 

.51075 

0.081 

-2.078 

0.0000  -0.94 

1.0000 

1.02 

74 

DDM<y7 

23 

.08696 

.28810 

2.743 

5.779 

0.0000  -0.30 

1.0000 

3.17 

75 

DDMiyS 

23 

.08696 

.28810 

2.743 

5.779 

0.0000  -0.30 

1.0000 

3.17 

76 

DtnWTP 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

77 

DDMnrio 

23 

.26087 

.44898 

1.019 

-1.000 

0.0000  -0.58 

1.0000 

1.65 

78 

ODMMYll 

23 

.13043 

.34435 

2.053 

2.322 

0.0000  -0.38 

1.0000 

2.53 

79 

Dai«yi2 

23 

.43478 

.50687 

0.246 

-2.022 

0.0000  -0.86 

1.0000 

1.12 

80 

D0>My22 

23 

.13043 

.34435 

2.053 

2.322 

0.0000  -0.38 

1.0000 

2.53 

81 

01BMY23 

23 

.21739 

.42174 

1.282 

-0.367 

0.0000  -0.52 

1.0000 

1.86 

82 

DOI«y24 

23 

.04348 

.20851 

4.188 

16.255 

0.0000  -0.21 

1.0000 

4.59 

83 

DDMMY2S 

23 

0.0000 

0.0000 

0.0000 

0.0000 

84 

DDMflnS 

23 

.43478 

.50687 

0.246 

-2.022 

0.0000  -0.86 

1.0000 

1.12 

85 

D0MMy27 

23 

.13043 

.34435 

2.053 

2.322 

0.0000  -0.38 

1.0000 

2.53 

86 

otBwns 

23 

.13043 

.34435 

2.053 

2.322 

0.0000  -0.38 

1.0000 

2.53 

87 

Ot]IMY29 

23 

.08696 

.28810 

2.743 

5.779 

0.0000  -0.30 

1.0000 

3.17 

88 

D<M<y30 

23 

.34783 

.48698 

0.598 

-1.711 

0.0000  -0.71 

1.0000 

1.34 

89 

DIMmi 

23 

.17391 

.38755 

1.610 

0.624 

0.0000  -0.45 

1.0000 

2.13 

46 

MPTRISXl 

23 

62.000 

70.336 

2.189 

3.933 

8.0000  -0.77 

285.00 

3.17 

47 

MPTR1SK2 

23 

1.8696 

1.2542 

-0.295 

-1.727 

0.0000  -1.49 

3.0000 

0.90 

48 

MPTRISIC3 

23 

1.7826 

1.2416 

-O.lSl 

-1.764 

0.0000  -1.44 

3.0000 

0.98 

49 

MRTRISK4 

23 

S.1739 

3.S117 

0.121 

-1.921 

1.0000  -1.19 

9.0000 

1.09 

SO 

MNOECPSl 

23 

7.6087 

11.220 

1.3S4 

0.784 

0.0000  -0.68 

39.000 

2.80 

SI 

MNOECPS2 

23 

20.739 

21.299 

1.8S8 

3.908 

0.0000  -0.97 

95.000 

3.49 

S2 

MNOBCPS3 

23 

20.348 

27.874 

1.361 

0.792 

0.0000  -0.73 

95.000 

2.68 

S3 

MNOBCPS4 

23 

68.783 

S9.749 

1.680 

2.180 

5.0000  -1.07 

255.00 

3.12 

S4 

MNOECPSS 

23 

343.63 

460.03 

2.032 

4.193 

3.6207  -0.74 

1971.3 

3.54 

ss 

MNOBCPS6 

23 

64.S6S 

66.373 

1.766 

2.87S 

5.0000  -0.90 

285.00 

3:32 

S6 

MPSRISKl 

23 

1.8261 

1.1929 

-0.296 

-1.S77 

0.0000  -1.53 

3.0000 

0.98 

S7 

MPSRXSK3 

23 

4.7826 

2.6961 

0.154 

-1.265 

1.0000  -1.40 

9.0000 

1.56 

S8 

MPRESCHl 

23 

.34783 

.48698 

0.S98 

-1.711 

0.0000  -0.71 

1.0000 

1.34 

S9 

MPRBSCH2 

23 

.6S217 

.48698 

-0.S98 

-1.711 

0.0000  -1.34 

1.0000 

0.71 

60 

MPRBSCH3 

23 

.60870 

.49901 

-0.417 

-1.904 

0.0000  -1.22 

1.0000 

0.78 

61 

MPRBSCH4 

23 

.6S217 

.48698 

-0.S98 

-1.711 

0.0000  -1.34 

1.0000 

0.71 

6S 

MPRSSCH6 

23 

.08696 

.28810 

2.743 

5.779 

0.0000  -0.30 

1.0000 

3.17 

62 

MPLAGOR 

23 

.21739 

.42174 

1.282 

-0.367 

0.0000  -0.52 

1.0000 

1.86 

63 

MSONRC 

23 

.6S217 

.48698 

-0.S98 

-1.711 

0.0000  -1.34 

1.0000 

0.71 

64 

MPLCCaK:3 

23 

1.043S 

1.3307 

0.S89 

-1.544 

0.0000  -0.78 

3.0000 

1.47 

66 

MSOWSINT 

23 

.47826 

.S107S 

0.081 

-2.078 

0.0000  -0.94 

1.0000 

1.02 

67 

MEVSINT 

23 

.43478 

.S0687 

0.246 

-2.022 

0.0000  -0.86 

1.0000 

1.12 

**•  N  O  T  E  KORTOSIS  VALUES  GREATER  THAN  EERO  INDICATE  A  DISTRIBUTION  WITH 
HEAVIER  TAILS  THAN  NORMAL  DISTRIBUTION. 


STBP  NO 


0 


45.413S 


STD.  ERROR  OP  1ST. 


ANALYSIS  OF  VARZANCR 

SON  OF  SQUARES 
RBSIDDAL  45372. SX3 


OF  MEAN  SQUARE 
22  2062.387 


> 


VARIABLES  IN  EQOATION 


VARIABLES  NOT  IN  EQUATION 


STD. ERR  F  AND  F 

VARIABLE  C»EFF.  OF  C»EFF  TOL.  REMOVE(L) 


(CONSTANT  S0.9CS2) 


PARTIAL  F  AND  P 

VARIABLE  CORR.  TOL.  RNTER(L) 


CTYPB  -0.1434 
PLAOGR  0.0699 
PLCOHC  -0.0726 
PAGESSOH  0.1534 
NOOIDS  -0.0515 
PLDRRFP  -0.2801 
SOWCSSR  -0.0114 
SONRCBP  -0.1317 
SOHFRSI  0.0878 
NOPMDZDS  0.2471 
NOEVCRIT-0.0548 
EVRCHP  0.2021 
EVRCBP  0.1497 
UCOSTCD  0.3910 
D_DP  -0.0963 
PRODOPT  0.1146 
HOBCPS  0.7793 
PLPRBSCH- 0.4464 
PLHBSDBV  0.2070 
SONDHBS  0.1732 
SOHSDISP- 0.0559 
SOHRCWP  -0.1112 
gVSDISP  0.2785 
PLSRISX  0 . 0015 

SET  SPLSRZSK 
PLSRZSKl-0.2421 
PLSRISK2  0.0836 
PLTRISK  0.0023 

SET  SPLTRISK 
PLTRZSKl-0.0265 
PLTRISK2  0.0096 
COIPLEX  0.3813 

SET  SCOHPLEX 
COMPLBXl  0.0349 
C0MPLBX2  0.2798 
TECRDEFN- 0.0400 

SET  STECHDEF 
TBCHDEFl  0.2189 
TECHDEF2-0.13S5 
TBCHDBF3-0.0280 
PLHBSL3  0.0694 

SET  SPLHBSL3 
PLHBSL31  0.4951 
PLNBSL3 2 -0.1574 
PLHBSL33-0.1123 

SET  SPTRZSX3 
DDMKYl  0.1601 
DDMMY2  0 . 0000 

D(m(Y3  0 . 0096 


1.0000 

0.44(1) 

1.0000 

0.10(1) 

1.0000 

0.11(1) 

1.0000 

0.51(1) 

1.0000 

0.06(1) 

1.0000 

1.79(1) 

1.0000 

0.00(1) 

1.0000 

0.37(1) 

1.0000 

0.16(1) 

1.0000 

1.37(1) 

1.0000 

0.06(1) 

1.0000 

0.89(1) 

1.0000 

0.48(1) 

1.0000 

3.79(1) 

1.0000 

0.20(1) 

1.0000 

0.28(1) 

1.0000 

32.48(1) 

1.0000 

5.23(1) 

1.0000 

0.94 (1) 

1.0000 

0.65(1) 

1.0000 

0.0. (1) 

1.0000 

0.26(1) 

1.0000 

1;77(1) 

1.0000 

0.00(0) 

F- 

0.63 

PmO. 

.54269(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

0.00(0) 

p> 

0.01 

P-0. 

.99298(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

3.57(0) 

F- 

1.75 

P-0. 

.19921(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

0.03(0) 

F- 

0.37 

P-0. 

.77325(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

0.10(0) 

F- 

2.16 

P-0. 

.12686(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

F- 

0.56 

P-0. 

.57841(1) 

1.0000 

(1) 

1.0000 

(1) 

1.0000 

(1) 

F 


A 


K-6 


F- 

0.31 

SET  SPTRISIC3 

P-0 

73740(1) 

OOMiy4  0.0606 

1.0000 

(1) 

IXEWYS  0 . 0000 

1.0000 

(1) 

DaiMy6  0.0736 

1.0000 

(1) 

P- 

0.18 

SET  SPLCCMCa 

P-0 

90593(1) 

DOtMT?  0.0579 

1.0000 

(1) 

DCMMTS  -0.1575 

1.0000 

(1) 

DOMTS  -0.0180 

1.0000 

(1) 

F- 

1.98 

SET  SPSRISKI 

P-0 

15132(1) 

DOMyiO  0.0236 

1.0000 

(1) 

OMiyil  -0.2421 

1.0000 

(1) 

OCMMyi2  -0.1978 

1.0000 

(1) 

F- 

0.32 

SET  SPTRISE4 

P-0 

85948(1) 

I»MNy32  -0.0436 

1.0000 

(1) 

DaMIT23  -0.1211 

1.0000 

(1) 

DaMiy24  -0.1822 

1.0000 

(1) 

DtM«y25  0.0000 

1.0000 

(1) 

DDM(T26  0.0971 

1.0000 

(1) 

F- 

0.90 

SET  SPSRISK3 

P-0 

50332(1) 

OCMMTST  0.1366 

1.0000 

(1) 

DOMMy28  -0.2627 

1.0000 

(1) 

Dt»My29  -0.1964 

1.0000 

(1) 

DOMtySO  0.0012 

1.0000 

(1) 

DOHOfyil  0.3327 

1.0000 

(1) 

MPTRISKl  0.6610 

1.0000 

16.29(1) 

MPTR1SIC2  0.0718 

1.0000 

0.11(0) 

MPTRISIC3  0.1147 

1.0000 

0.28(0) 

MPTRISK4  0.0462 

1.0000 

0.04(0) 

MliOBCPSl  0.2324 

1.0000 

1.20(1) 

miOBCPS2  0.4675 

1.0000 

5.87(1) 

»0K>BCPS3  0.6305 

1.0000 

13.86(1) 

MNOBCPS4  0.7482 

1.0000 

26.71(1) 

MEOBCPSS  0.7031 

1.0000 

20.53(1) 

MtlOBCPS6  0.7503 

1.0000 

27.05(1) 

NPSR1SK1-0.3B30 

1.0000 

3.61(0) 

MPSRISK3  0.2711 

1.0000 

1.67(0) 

MPRBSCHl-0.2333 

1.0000 

1.21(1) 

MPRBSCB2-0.5781 

1.0000 

10.54(1) 

HPRBSCH3 -0.4407 

1.0000 

5.06(1) 

MPRESCH4- 0.1944 

1.0000 

0.82 (1) 

MPRBSCH6- 0.1658 

1.0000 

0.59(1) 

MPUGCat  0.0699 

1.0000 

0.10(1) 

MSONRC  -0.1317 

1.0000 

0.37(1) 

MPLC0NC3 -0.0739 

1.0000 

0.12(0) 

MSOHSINT-0 . 1123 

1.0000 

0.27(1) 

MBVSIHT  0 . 0682 

1.0000 

0.10(1) 

K-7 

snp  NO. 


1 


VMIZABLK  BNTBRBD  9  NOBCPS 

MDI.TXPI.B  R  0 . 7793 

MOLTZPLS  R-SgtnUtB  0.«073 

ADJUSTED  R-SQUARB  0.S886 

STD.  ERROR  OP  BST.  29.1276 

ANALYSIS  OF  VARIANCE 

SUN  OP  SQUARES  OP  MEAN  SQUARE  P  RATIO 

RBQRESSIOM  27555.752  1  27555.75  32.48 

RESIDUAL  17816.762  21  848.4172 

VARIABLES  IN  EQUATION  VARIABLES  NOT  IN  EQUATION 


STD. ERR  P  AND  P  PARTIAL  F  AND  P 

VARIABLE  COBPP.  OP  COBPP  TOL.  RBMOVB(L)  VARIABLE  C(»R.  TOL.  BNTBR(L) 


(CONSTANT  8.0927) 

NOBCPS  1.4940  0.2622  1.0000 


CTYPB  0.1577 

0.9071 

0.51(1) 

PLAOOR  -0.1911 

0.9429 

0.76(1) 

PLCONC  0.4541 

0.8204 

5.20(1) 

PAOBSSOH  0.2181 

0.9995 

1.00(1) 

NODIDS  0.2806 

0.9202 

1.71(1) 

PIDRRPP  -0.0285 

0.8859 

0.02(1) 

SONCSSR  0.2917 

0.9414 

1.86(1) 

SONRCBP  -0.1104 

0.9935 

0.25(1) 

SONPRSl  0.1464 

1.0000 

0.44(1) 

NOPHDIDS  0.5661 

0.9820 

9.43(1) 

NOBVCRIT  0.1805 

0.9550 

0.67(1) 

EVRCPIP  0.4111 

0.9950 

4.07(1) 

BVRCBP  0.3959 

0.9847 

3.72(1) 

DCOSTCD  0 . 1434 

0.8434 

0.42(1) 

D  DP  -0.0732 

0.9958 

0.11(1) 

PRODOPT  0.2974 

0.9917 

1.94(1) 

PLPRESCH-0 . 7172 

1.0000 

21.18(1) 

PLNBSDEV  0.1302 

0.9737 

0.35(1) 

SONDHBS  0.0693 

0.9720 

0.10(1) 

SOHSDISP- 0.0298 

0.9977 

0.02(1) 

SOHRCNP  0 . 0180 

0.9753 

0.01(1) 

BVSDISP  -0.0028 

0.8708 

0.00(1) 

PLSRISK  0 . 0473 

0.9987 

0.04(0) 

P> 

0.18 

SET  SPLSRISK 

P.O. 

.83783(1) 

PLSRISKl-0.1322 

0.9573 

(1) 

PLSRZSK2  0.0866 

0.9986 

(1) 

PLTRISK  -0.0455 

0.9984 

0.04(0) 

P- 

0.03 

SET  SPLTRISK 

P-0. 

.96992(1) 

PLTRZSKl  0.0356 

0.9961 

(1) 

PLTR1SX2-0.0532 

0.9970 

(1) 

COMPLEX  0.1589 

0.8626 

0.52(0) 

P- 

0.25 

SET  SCOHPLBX 

P-0. 

.78141(1) 

CCMPLBXl  0.0060 

0.9984 

(1) 

CCMPLBX2  0.1169 

0.9279 

(1) 

TECHDBPN  0.2843 

0.9264 

1.76(0) 

?• 

1.34 

SET  STBCHDBP 

P>0 

.29357(1) 

TECHDBPl- 0.0913 

0.8777 

(1) 

TBCHDBP2-0.2546 

0.9991 

(1) 

TECHDBP3  0.4096 

0.8810 

(1) 

PLHBSL3  0.0081 

0.9932 

0.00(0) 

P. 

0.45 

SET  SPLHBSL3 

P>0 

.71825(1) 

PLHBSL31  0.2553 

0.7954 

(1) 

PLNBSL32-0 . 0274 

0.9675 

(1) 

PLNBSL33-0.0B29 

0.9940 

(1) 

F-  0.34 

SIT  srnixsKS  f-o.7i«ss(i) 

ODHNn  0.1639  0.994S  (1) 

DDMiyS  0.0000  1.0000  (1) 

OOMTl  -0.0S32  0.9970  (1) 

r-  0 . OS 

SIT  SPTRISK3  P>0. 95007(1) 

OaMY4  0.0456  0.99S3  (1) 

DOMTS  0.0000  1.0000  (1) 

DOMTS  O.OOSS  0.9923  (1) 

r-  1.68 

SIT  SFLC0HC3  P-0. 20698(1) 

OMfln  0.1789  0.9952  (1) 

DOMTO  0.0259  0.9505  (1) 

DCMm  0.3487  0.9151  (1) 

P-  6.46 

SIT  SPSRISXI  P-0. 00370(1) 

Dtimno  -0.1381  0.9803  (1) 

DtaMTll  -0.1322  0.9573  (1) 

DOMMYll  -0.3394  0.9996  (1) 

P-  0.53 

SIT  SPTUSK4  P-0.71683  (1) 

D0Miy22  0.2063  0.9526  (1) 

DaMMy23  -0.1285  0.9973  ID 

DaMT24  -0.2487  0.9988  (1) 

Downs  0.0000  1.0000  (i) 

DOWy26  0.0701  0.9953  (1) 

P-  0.57 

SIT  SPSRISIC3  P-0.71913  (1) 

OOWy27  -0.0601  0.9505  (1) 

OOWT3B  -0.3091  0.9920  (1) 

DOWT29  -0.1^76  0.9797  (1) 

DOWnO  0.1179  0.9914  (1) 

OOWni  0.1924  0.9225  (1) 

NPTRISICl-0.0745  0.2310  0.11(1) 

HPTIUS1C2-0.003S  0.9910  0.00(0) 

MPTIUSIO  0.0285  0.9845  0.02(0) 

MPTRZSX4  0.0254  0.9985  0.01(0) 

MiOICPSl  0.5739  0.9752  9.82(1) 

miOIC3?S2  0.0638  0.6895  0.08(1) 

MiOICPSl -0.2926  0.1760  1.87(1) 

MI08CPS4  0.2740  0.2930  1.62(1) 

Ni08CPSS-0.0119  0.1788  0.00(1) 

MiOSCPSB  0.0361  0.0897  0.03(1) 

MPSRISKl-0.5592  0.9982  9.10(0) 

MPSRZSK3  0.1925  0.9616  0.77(0) 

NPRISCHl  0.1368  0.8398  0.38(1) 

MPItlSCH2-0.6142  0.9294  12.11(1) 

MntlSCR3-0.5465  0.9832  8.52(1) 

MPItlSCH4-0.2447  0.9972  1.27(1) 

MPIII8CH6-0.0883  0.9797  0.16(1) 

MPIA9SR  -0.1911  0.9429  0.76(1) 

MSONRC  -0.1104  0.9935  0.25(1) 

IIPLC0NC3  0.4238  0.8350  4.38(0) 

MSONSZIIT'0.0081  0.9810  0.00(1) 

MSVSZIT  0.1464  0.9991  0.44(1) 


am  NO 
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VMtZABLI  BRnXO  10  PLPWUCH 


MJLTIKJI  R 
MOLTIFLI  R-SQOMtl 
ADJOSm  R-SQORRI 


0.8»9< 

0.0093 

0.7902 


* 


SID.  aaoR  or  ist.  20.tooc 


AHRLYSZS  or  VARZANCl 


SOM  or  8Q0ARBS 

Dr 

NBAN  SQOARB 

RBORBSSZOH 

34719.244 

2 

18359.42 

RBSZOOAL 

8453.2474 

20 

432.4434 

r  RATIO 
42.43 


VARZABLIS  ZN  IWIATZaH 


VARZABLBS  HOT  ZM  IQDATIOM 


VARZABLI  COBrr. 


(CONSTANT  51.4994) 
NOICrS  1.4974 
PLPRBSCH  -52.4412 


STD.BRR 

or  COBrr 


r  AND  9 
TOL.  RmOVI(L) 


PARTIAL 


r  AND  P 


VARZABLB  CQRR. 

TOL. 

BHTBR(L) 

CTYPR  0.3749 

0.8891 

3.11(1) 

PLA0(Sl  -0.0195 

0.8849 

0.01(1) 

PLCQHC  0.5841 

0.8149 

9.94(1) 

PAOBSSON  0.2935 

0.9992 

1.79(1) 

NOOID8  0.4335 

0 . 9194 

4.40(1) 

PUNtRTP  -0.2744 

0.8421 

1.57(1) 

SONCSSR  0.3541 

0.9378 

2.74(1) 

SONRCBP  -0.0048 

0.9719 

0.00(1) 

SONTRSI  0.0276 

0.9484 

0.01(1) 

HOPMOZDS  0.4344 

0.8225 

4.42(1) 

NOSVCRZT  0.1427 

0 . 9445 

0.52(1) 

BVRCMP  0.3814 

0 . 9508 

3.24(1) 

RVRCBP  0.2349 

0.8727 

1.11(1) 

DCOSTCD  0.1037 

0.8350 

0.21(1) 

D  DP  -0.0930 

0.9957 

0.17(1) 

tmaoovr  0.2541 

0.9424 

1.31(1) 

PUIBSDSV  0.2835 

0.9453 

1.44(1) 

SONDHBS  0.1958 

0.9437 

0.74(1) 

SONSDZSP-0.0052 

0.9944 

0.00(1) 

SONRCNP  *0.2325 

0.9171 

1.09(1) 

BVSDISP  0.0412 

0.8473 

0.07(1) 

PLSRZSK  -0.0587 

0.9837 

0.07(0) 

F- 

0.03 

SBT  SPLSRZSK 

P-0. 

.94884(1) 

PLSRZSXl-0.0020 

0.9254 

(1) 

PL8RZS1C2-0.0527 

0.9493 

(1) 

PLTRZSK  -0.1253 

0.9951 

0.30(0) 

F- 

0.70 

SBT  SPLTRZSK 

P-0 

.50748(1) 

PLTRISKl-0.2308 

0.9257 

(1) 

PLTRZSIC2-0.0559 

0.9944 

(1) 

COMPLBX  0.0751 

0.8434 

0.11(0) 

F- 

0.82 

SBT  SCOMnSB 

P-0< 

.45784(1) 

COMPLBXl  0.2741 

0.9342 

(1) 

CaMPLBZ2-0.1039 

0.8449 

(1) 

TBCNDBrH  0.5845 

0.9010 

9.94(0) 

r- 

4.24 

SBT  STBCBDBP 

P-O. 

.00472(1) 

TBCHDBri-0.4224 

0.8144 

(1) 

TBCBDBr2-0.1521 

0.9548 

(1) 

TBCHDBri  0.4941 

0.8718 

(1) 

PLMB8L3  0.0398 

0.9924 

0.03(0) 

r- 

0.59 

SBT  SPLNB8L3 

P-O. 42744(1) 

PL'IBSL31  ^.0792 

0.7321 

(1) 

PLNBSL32  U.2SS7 

0.8928 

(1) 

PLNB8L3 3 -0.1070 

0.9938 

(1) 

0.1872  1.0000 
11.4429  1.0000 


r 


K-IO 


S*T  SPTIIXSK2 
DOMYl  0.3913 
OCMHn  0.0000 
OtMIYS  -0.0559 

SR  SPTRISX3 

DaMrr4  o.i630 
DOMiyS  0.0000 
OOMYS  -o.ooas 

SR  SVLC0IIC3 
DQMflrr  0.4073 
DOMiyS  0.189S 
OOMMYS  0.3411 

SR  SPSRISXl 
DCMfYlO  O.OSSO 
DOMYll  -0.0030 
D0MMY13  -0.0796 

SR  SPTRZSK4 
OOMIY33  0.1369 
DCMMY33  -0.3317 
DDMIY34  -0.3573 
DOWYSS  0.0000 
DDMIY36  0.0381 

SR  spsmsu 
Dt»MY37  0.1031 
OOMNY38  -0.3638 
0(MIY39  -0.0503 
DCIMY30  0.3681 
DtMmi  -0.1634 
KPTRlSXl-0.0536 
NPTRISK3  0.0408 
MPTIUSX3  0.0533 
MPTRZSK4 -0.0431 
NN0BCP81  0.6538 
iaX»CP83-0.1357 
MIIOSCPS3 -0.3435 
miOBCPS4  0.4403 
MNOBCPS5  0.0038 
miOBCPS6-0.0301 
MPSRISICl-0.0900 
MPSmSU  0.0078 
MPRBSCHl  0.6175 
MPRSSCH3-0.3766 
MPRUCH3-0.3335 
NPIUSCR4  0.3816 
MPItX8ai6  0.0313 
MPUKXBt  -0.0195 
MSONRC  -0.0068 
NPLC0IIC3  0.4353 
NSONsnrr-0.0318 
MKVSZR  0.1483 


p- 

1.33 

P-0 

.39307(1) 

0.9916 

(1) 

1.0000 

(1) 

0.9966 

(1) 

F- 

0.47 

P-0 

.63440(1) 

0.9895 

(1) 

1.0000 

(1) 

0.9919 

(1) 

P- 

3.63 

P-0, 

.03433(1) 

0.9751 

(1) 

0.9303 

(1) 

0.8533 

(1) 

P- 

0.07 

P-0. 

.93805(1) 

0.9063 

(1) 

0.9354 

(1) 

0.8377 

(1) 

P- 

0.74 

P-0. 

.58010(1) 

0.9363 

(1) 

0.9960 

(1) 

0.9893 

(1) 

1.0000 

(1) 

0.9917 

(1) 

P- 

0.46 

P-0. 

.79957(1) 

0.9193 

(1) 

0.9603 

(1) 

0.9595 

(1) 

0.9834 

(1) 

0.7659 

(1) 

0.3304 

0.05(1) 

0.9890 

0.03(0) 

0.9844 

0.05(0) 

0.9935 

0.04(0) 

0.9454 

14.18(1) 

0.6595 

0.30(1) 

0.1705 

1.19(1) 

0.3934 

4.57(1) 

0.1787 

0.00(1) 

0.0893 

0.01(1) 

0.4833 

0.16(0) 

0.8960 

0.00(0) 

0.7365 

11.71(1) 

0.5334 

1.57(1) 

0.6551 

1.09(1) 

0.6033 

3.34(1) 

0.9595 

0.01(1) 

0.8849 

0.01(1) 

0.9719 

0.00(1) 

0.8096 

4.44(0) 

0.9807 

0.02(1) 

0.9955 

0.43(1) 

snv  MO 
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VMUABLB  INTBilBD  50  MII»CPSX 

NOLTXnjI  R  0.9430 

NOLTZPLS  R-SQOMtB  0.0900 

AOJOSTID  tt-SQOm  0.0730 

STD.  RRRCRt  OF  RST.  10.1405 

AHRLY8ZS  OF  VRRZMKI 

soot  OF  SamitMS  of  NSAV  SQOautS  F  RATIO 
RMORISSIOH  40417.020  3  13472.01  51.00 

RlSZOOaU.  4954.0031  19  200.7720 


VARZABLIS  IM  EOOOITIOII  VARIABLES  HOT  »  SQDATIOH 


STD.BRR 

F  AMD  P 

PARTIAL 

P  AMD  P 

VARZABLB  COBFF. 

OF  com 

TOL.  RBMOVB(L) 

VARIABLE  con.  TOL. 

BRTBR(L) 

(COHSTAMT  35.0109) 

N(»CFS  1.5050  0.1472  0.9740  110.01(1)  CTYFt  0.1002  0.0973  0.21(1) 

PLPRBSCH  -40.7239  9.0225  0.9095  20.02(1)  PLAOOR  -0.0022  0.8011  0.12(1) 

NHOBCFSl  1.1005  0.3150  0.9454  14.10(1)  PLCOHC  0.1249  0.2701  0.29(1) 

FAtaSSOM  0.3030  0.9093  1.83(1) 

MCSZOS  0.3410  0.0454  2.38(1) 

PLDRRFF  -0.1100  0.7093  0.25(1) 

SONCSSR  0.1751  0.0194  0.57(1) 

SONRCBP  -0.1255  0.9540  0.29(1) 

SCHFRSI  -0.1033  0.9009  0.03(1) 

HOPMDIOS  0.4308  0.7999  4.25(1) 

NOSVCRZT  0.3397  0.9270  2.35(1) 

gncm  0.2087  0.8733  1.40(1) 

RVRCBP  0.0305  0.7800  0.02(1) 

OCOST(3>  -0.0859  0.7808  0.13(1) 

0  OP  0.2003  0.8070  0.75(1) 

piooOPT  -0.0250  0.7903  0.01(1) 

PLNBSDBV  0.0535  0.0280  0.05(1) 

SONDNBS  0.0573  0.9104  0.00(1) 

SOiaDZSP-0.1530  0.9085  0.44(1) 

SOHRCNP  -0.1001  0.0920  0.52(1) 

SVSDZSP  0.0099  0.8072  0.09(1) 

PLSRZSK  -0.0980  0.9831  0.18(0) 

P-  0.09 

SBT  SPLSRISK  P-0. 91577(1) 

PLSRZSia-0.0138  0.9253  (1) 

PLSRZSK2-0.0051  0.9090  (1) 

PLTRZSK  -0.2003  0.9935  0.75(0) 

F-  0.40 

SBT  SPLTUSK  P-0. 07737(1) 

PLTRZSXl- 0.0505  0.0488  (1) 

PLTRZS1C2- 0.1755  0.9831  (1) 

CONPLBX  -0.1000  0.7997  0.18(0) 

P-  0.15 

SBT  SCOMPLBX  P-0. 80102(1) 

COMPLBXl  0.0902  0.0455  (1) 

COMFLBZ2-0.1300  0.0049  (1) 

TBCHDBFH  0.5000  0.7942  0.29(0) 

P-  3.71 

SBT  8TBCRDBF  P-0. 03373(1) 

TBCaDBFl-0.3450  0.7592  (1)  F 

TBCBDBF2-0.1019  0.9420  (1) 

TBCBDBF3  0.0095  0.7130  (1) 

PLMB8L3  0.0130  0.9904  0.00(0) 

F-  1.37 

SBT  SPLNBSU  P-0. 28038(1) 

PLNE^l-0.3427  0.5097  (1)  * 

PLIIBSL32  0.3271  0.8927  (1) 

PLMBSL33- 0.1190  0.9932  (1) 


K-12 


SST  8»TUSn 
DCMnri  0.2337 
DOMMn  0.0000 
DOMm  -0.1755 

SIT  smisu 
0CMrr4  0.21C5 
DCMKS  0.0000 
DOMNTS  -0.1C73 

SST  SPLCOWn 
DDMir?  0.1410 
DOMMTS  0.1475 
DCMiy»  -0.1174 

SIT  SMUSKl 
DOMTIO  0.040S 
OQMflni  -0.013S 
D)Mnn2  -0.027C 

SIT  SPTI2SK4 
mMIT22  0.2127 
DOMnni  0.0492 

Damn*  -0.2203 

D0MIY25  0.0000 
DlMm«  -0.1531 

SIT  SPSR1S1C3 
DaMT27  -0.10C2 
KMnraS  -0.1245 
OaMfTTO  -0.0145 
DCMnr30  0.17S8 
DOMTll  -0.2054 
MPTiUSKl-0.0895 
NPTRISia-0.1303 
Mt>TIU8IC3 -0.1216 
MPT1U8X4-0.1816 
NiiOICPS2  0.0023 
IQIOICPS3-0.0665 
MIiOSCPS4  0.2493 
MIIOICP85-0.0288 
MH08CP86-0.0157 
MPSRI8K1- 0.0364 
MPSRISIC3-0.1066 
MPRS8CH1  0.3211 
MPRS8CH2-0.1166 
NPilSSai3-0.1681 
NPi(S8CH4  0.2687 
MPRI8CM6- 0.2512 
MPLiaSR  -0.0822 
M80NRC  -0.1255 
MPLCCIIC3 -0.0124 
N80NSIMT-0.1800 
MIVSniT  0.0968 


F- 

0.49 

F*0. 

62016(1) 

0.9597 

(1) 

1.0000 

(1) 

0.9831 

(1) 

r- 

0.42 

P>iO. 

66328(1) 

0.9895 

(1) 

1.0000 

(1) 

0.9608 

(1) 

Vm 

0.33 

P-0. 

.80324(1) 

0.7508 

(1) 

0.9167 

(1) 

0.6506 

(1) 

P- 

0.01 

P-0 

.98599(1) 

0.8993 

(1) 

0.9253 

(1) 

0.8310 

(1) 

P- 

0.43 

P-0 

.78541(1) 

0.9238 

(1) 

0.8433 

(1) 

0.9696 

(1) 

1.0000 

(1) 

0.9389 

(1) 

P- 

0.34 

P-0 

.87961(1) 

0.8500 

(1) 

0.8931 

(1) 

0.9560 

(1) 

0.9391 

(1) 

0.7658 

(1) 

0.2303 

0.15(1) 

0.9455 

0.31(0) 

0.9373 

0.27(0) 

■0.9725 

0.61(0) 

0.6345 

0.00(1) 

0 . 1554 

0.08(1) 

0.2432 

1.19(1) 

0.1784 

0.01(1) 

0.0893 

0.00(1) 

0.4778 

0.02(0) 

0.8798 

0.21(0) 

0.4024 

2.07(1) 

0.4872 

0.25(1) 

0.6376 

0.52(1) 

0.5531 

1.40(1) 

0.8679 

1.21(1) 

0.8811 

0.12(1) 

0.9546 

0.29(1) 

0.4393 

0.00(0) 

0.9536 

0.66(1) 

0.9822 

0.17(1) 

STI9  HO 


4 


vMtzjuuji  nmuD  sit  sncHDir 

40  TKHDIFl 

41  TICHDiri 

42  TKHDira 

MOLTIPUI  R  0 . 9S73 

NOLTZPLI  R-SQURRI  0.935S 

ADJ08T1D  R-SQORRI  0.9114 

STD.  IRROR  or  I8T.  13.5165 


AKRI.YSXS  OP  VMIXMICI 


STM  OP  SOTJARIS 

OP 

MIAH  SQOARB 

RIORISSZOH 

43449.391 

6 

7074.898 

RBSZDOAL 

3933 . 1352 

16 

183.6953 

P  RATIO 
38.73 


8 


> 


VARXABLIS  ZH  ■QaXTZOH 


VARZABLIS  HOT  ZH  RQOATZQN 


STD.BtR  P  AHD  P  PARTZAL  P  AND  P 

VARZABLI  COIPP.  OP  COIPP  TOL.  RBIOVI(L)  VARXABLB  CORR.  TOL.  BHTBR(L) 


(COMSTAHT 

33.4358) 

NOICPS 

1.7477 

0.1341 

0.8236 

169.77(1) 

CTYPI  0.0166 

0.5747 

0.00(1) 

PLPRBSCH 

-53.8783 

8.1033 

0.8430 

44.31(1) 

PLAflOl  0.0627 

0.8363 

0.06(1) 

P- 

3.71 

SIT  snoiDBP 

P-0 

.03373(1) 

TBCHDIPl 

-6.5570 

8.541 

0.5647 

(1) 

PL(X3NC  0.0839 

0.2279(0.749) (1) 

TBaiDIP2 

3.4086 

9.2006 

0.6531 

(1) 

TICHDBP3 

21.3913 

8.3170 

0.5063 

(1) 

MNOBCPSl 

0.7541 

0.2948 

0.7593 

6.54(1) 

PAQBSSON  0.3281 

0.6155 

1.81(1) 

HODZOS  0.5257 

0.6845 

5.73(1) 

PLDRRPP  -0.2500 

0.6076 

1.00(1) 

SONCSSR  0.1311 

0.7421 

0.26(1) 

SOMRCBP  -0.3487 

0.9348 

0.99(1) 

SCMFRSZ  -0.1834 

0.8560 

0.52(1) 

HOPMD)[DS  0.4345 

0.7435 

3.30(1) 

HOBVCRZT-0.6385 

0.6342 

0.01(1) 

BVRCNP  0.0638 

0.6278 

0.06(1) 

BVRCBP  -0.1439 

0.4807 

0.32(1) 

UCOSTCD  -0.2418 

0.5658 

0.93 (1) 

D  DP  0.4820 

0.6551 

4.54(1)- 

PRODOPT  -0.1931 

0.7438 

0.58(1) 

PLNBSDBV- 0.0001 

0.7469 

0.00(1) 

SONDWBS  0 . 0420 

0.9005 

0.03 (1) 

SOMSDZSP- 0.0304 

0.9234 

0.01(1) 

SONRCNP  -0.2637 

0.8052 

1.12(1) 

KVSDZSP  -0.0797 

0.7445 

0.10(1) 

PLSRZSX  -0.2659 

0.8733 

1.14(0) 

P- 

0.82 

SIT  SPLSRZSK 

P-0. 

.46114(1) 

PI.SRZSKl-0.1149 

0.8109 

(1) 

PI.SR1SK2-0.1962 

0.9301 

(1) 

PLTRZSX  -0.2531 

0.9011 

1.03(0) 

P- 

0.50 

SIT  SPLTRZSK 

P-0. 

.61804(1) 

PDTRZSKl  0.0610 

0.7967 

(1) 

PLTRZS1C2- 0.2569 

0.8942 

(1) 

CCMPLBX  -0.1655 

0.4677 

0.42(0) 

P- 

0.23 

SIT  SCOHPLBX 

P-0. 

79556(1) 

COMPLBZl  0.0830 

0.8216 

(1) 

C0MPLBX2-0.1697 

0.6023 

(1) 

TBCHDBPN  0.0000 

1.0000 

0.00(0) 

PLMBSL3  -0.0598 

0.4862 

0.05(0) 

F- 

0.30 

SIT  SPLNBSL3 

P>0. 

.82616(1) 

PLMBSL31-0.1311 

0.4161 

(1) 

PLIOSL32  0.1838 

0.7161 

(1) 

PLNBSL33-0.1382 

0.3400 

(1) 

K-14 


F- 

0.61 

SR  SPTKISIQ 

P-0. 

.55654(1) 

DCMIYl  0.2715 

0.9439 

(1) 

ODMm  0 . 0000 

1.0000 

(1) 

DDMiyS  -0.25C9 

0.8942 

(1) 

F- 

0.78 

SR  SRRZSK3 

P-0. 

.47724(1) 

Ot»My4  0.3099 

0.9227 

(1) 

DOMflrS  0.0000 

1.0000 

(1) 

DOMYS  -0.3647 

0.9179 

(1) 

F- 

0.60 

SR  SPLCOIIC3 

P-0. 

.63489(1) 

DQMfln  0.3063 

0.6540 

(1) 

DOMiyS  -0.0817 

0.8000 

(1) 

OCMflrS  -0.0838 

0.6363 

(1) 

F- 

0.52 

SR  SPSRZSKl 

P-0. 

.60348(1) 

OtMlYlO  0.2544 

0.7864 

(1) 

DOMMyil  -0.1149 

0.8109 

(1) 

DaMMyi2  -0.1433 

0.8172 

(1) 

F- 

0.35 

SR  SPTRISK4 

P-0 

.84236(1) 

Dawy32  0.0297 

0.8037 

(1) 

OOMCnS  0 . 1102 

0.8326 

(1) 

l»awy34  -0.0783 

0.7945 

(1) 

OlM(y35  0.0000 

1.0000 

(1) 

I»MIY26  -0.2702 

0.9175 

(1) 

F- 

1.17 

SR  SPSRIS1C3 

P-0 

.38169(1) 

DtMflr27  -0.1421 

0.6217 

(1) 

DOHMYRS  -0.1678 

0.8393 

(1) 

DaMMY29  0.0035 

0.8572 

(1) 

DaMNY30  0.0867 

0.8737 

(1) 

DDHHY31  -0.2340 

0.6122 

(1) 

MPTRISXl-0.2039 

0.2043 

0.65(1) 

KPTRISK2-0.2162 

0.8380 

0.74(0) 

MPTIUSIC3- 0.2056 

0.9113 

0.66(0) 

NPTRISK4- 0.2903 

0.9610 

1.38(0) 

NilOtCPS2  0.0766 

0.5206 

0.09(1) 

MliOBCPS3 -0.1042 

0.1523 

0.16(1) 

MliOBCPS4-0.2929 

0.0702 

1.41(1) 

«IOBCPS5-0.0575 

0.1215 

0.05(1) 

MtlOBCPS6  0.1075 

0.0477 

0.18(1) 

MPSRISKl- 0.2086 

0.4503 

0.68(0) 

MPSRISIO -0.2380 

0.6348 

0.90(0) 

MPRBSCHl  0.3434 

0.3684 

2.00(1) 

MPRBSCII3-0.2500 

0.3848 

1.00(1) 

MPItBSCH3-0.2637 

0.5753 

1.13(1) 

HPItB8C84  0.0638 

0.3976 

0.06(1) 

NPItBSCH6  0.0460 

0.6043 

0.03(1) 

MPLMOR  0.0637 

0.8363 

0.06(1) 

MSONRC  -0.3487 

0.9348 

0.99(1) 

IIPl«3IIC3- 0.0707 

0.4182 

0.08(0) 

NSOWSIR- 0.3030 

0.9245 

0.64(1) 

MBVSZR  -0.0394 

0.8086 

0.01(1) 

K-15 


STIP  NO 
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VMIZABLI  SHTBUtD  X7  MODIDS 

MOLTZPLC  R  0.97«4 

MOLTIPIil  R-SQOMtR  0.9S34 

ADJOSTB)  R-SQUMIC  0.931C 

STD.  mtOR  OP  B8T.  IX. 8749 

ARRLYSZS  OP  VMUAHCS 

SOM  OP  SQOMIBS  OP  KSMI  SOdARS  P  RATIO 

RVatlSSICM  432S7.334  7  SX79.6X8  43.82 

RKSIOORL  2115. X907  15  141.0137 


VARIABLES  IN  RQOKTIOH  VARIABLES  MOT  IN  EQOATIQN 


VARIABLE 

COEPP. 

STD. ERR 

OP  COEPP  TOL. 

P  AMD  P 
REMOVE (L) 

VARIABLE 

PARTIAL 

CORR.  TOL. 

P  AMD  P 

BHTER(L) 

(COHSTAHT 

MODIDS 

15.5941) 

0.3495 

0.1460  0.6845 

5.73(1) 

CTYPB 

0.0168  0.5747 

0.00(1) 

HOBCPS 

1.8317 

0.1230  0.7555 

221.92(1) 

PUUSOR 

-0.2021  0.6912 

0.60(1) 

PLPRESCH 

-54.4655 

7.1234  0.8410 

58.46(1) 

PLCCHC 

0.0110  0.2233 

0.00(1) 

P>  5.34 

SET  STECHDEP  P-0. 01052(1) 

TEC3iDEPl  -11.2717  7.758  0.5283  (1)  PAOESSCM  0.4001  0.8151(0.125)  (1) 

TBCHDEP2  -6.8385  8.9585  0.5317  (1) 

TECRDEP3  18.0158  7.4417  0.4880  (1) 

MNOECPSl  0.5489  0.2728  0.8842  4.05(1)  PLORRPP  -0.2491  0.8044  0.93(1) 

SONCSSR  0.2003  0.7380  0.59(1) 

SONRCBP  -0.3173  0.9333  1.57(1) 

SOWFRSI  -0.1335  0.8409  0.25(1) 

NOPMDIDS  0.3198  0.6890  1.60(1) 

tlOBVCRIT-0.0211  0.6340  0.01(1) 

BVRCMP  0.1078  0.6260  0.18(1) 

BVRCBP  -0.1181  0.4771  0.19(1) 

0C0STC3}  -0.3009  0.5654  1.39(1) 

D_DP  0.4330  0.8124  3.05(1) 

mODOVT  -0.2133  0.7434  0.67(1) 

PLNBSDEV  0.1326  0.7186  0.21(1) 

SOHDNBS  0.1908  0.8564  0.53(1) 

SOWSDISP-0.0177  0.9326  0.00(1) 

SONRCMP  -0.2894  0.8043  1.28(1) 

EVSDISP  0.0111  0.7232  0.00(1) 

PLSRZSK  -0.0437  0.7025  0.03(0) 

P-  0.06 

SET  SPLSRISK  P-0.94213 (1) 

PL5RISX1-0.0660  0.8006  (1) 

PLSRZSIC2-0.0144  0.8153  (1) 

PLTRZSK  -0.1883  0.8712  0.51(0) 

P-  0.29 

SET  SPLTRZSK  P-0.75374 (1) 

PLTRZSKl- 0.0840  0.7478  (1) 

PLTRZSK2- 0.1589  0.8431  (1) 

COMPLEX  -0.1585  0.4661  0.36(0) 

P-  0.36 

SET  SCOMPLEX  P-0.70760 (1) 

COMPLEXl  0.1776  0.8083  (1) 

C0MPLXX2-0.2268  0.6012  (1) 

TECHDEPM  0.0000  1.0000  0.00(0)  P 

PLMBSL3  -0.0307  0.4843  0.01(0) 

P-  0.05 

SET  SPLNBSL3  P-0. 98429(1) 

PLNBSL31  0.0364  0.3773  (1) 

PLHBSL32  0.0501  0.6632  (1) 

PLWBSL33 -0.1076  0.3373  (1)  * 
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SIT  SPTRISIC2 
OCMNYl  0.3527 
0tMfT3  0.0000 
DDWfy3  -0.1589 

SIT  SPTIIISX3 
DaMfT4  0.3014 
DOMTS  0.0000 
DOMMTe  -0.1522 

SIT  SPLCCIIC3 
NSMn  0.2915 
DOMNYS  -0.0338 
maans  -o.i583 

SIT  SPSRISKl 
DOHMTIO  0.0959 
DCMIYll  -0.0660 
DCMHyi2  -0.0349 

SIT  SPTRISK4 
OaMy22  -0.0570 
DDMNy33  0.1434 
D0MMy24  -0.0643 
OCMNT2S  0.0000 
D0Mff26  -0.1466 

SIT  SPSRISIC3 
DOMMy27  -0.1884 
OOMflnS  -0.2260 
Ot]MMY29  0.0925 
OaHHTSO  0.1397 
DOlimi  -0.1328 
MPTRI8K1-0 . 1068 
MPTIUS1C2-0.0981 
HPTRISK3- 0.0662 
NPTRISK4- 0.1498 
NNOSCPS2-0.0317 
MNOICPSS  0.0151 
MHOICPS4- 0.0767 
MH08CPS5-0.2401 
MNOSCPS6-0.0161 
HPSRISKl-0.0673 
MPSR2SX3-0.0576 
MPRISCai  0.2601 
NPR8SCH3-0.2491 
MPRSSCH3- 0.2894 
MPRIS(3i4  0.1076 
KPRISCH6-0.0450 
MPLMSOR  -0.2021 
MSONRC  -0.3173 
MP1<CONC3-O.1384 
MSOWSIMT-0.3413 
HIVSIMT  0 . 0606 


Fa 

0.46 

PaO. 

64219(1) 

0.9335 

(1) 

1.0000 

(1) 

0.8431 

(1) 

Fa 

0.71 

PaO. 

51050(1) 

0.9136 

(1) 

1.0000 

(1) 

0.8539 

(1) 

Fa 

0.40 

PaO. 

.75773(1) 

0.6455 

(1) 

0.7915 

(1) 

0.6305 

(1) 

Fa 

0.08 

PaO. 

.92514(1) 

0.6966 

(1) 

0.8006 

(1) 

0.7785 

(1) 

Fa 

0.12 

PaO. 

.97040(1) 

0.7862 

(1) 

0.8333 

(1) 

0.7928 

(1) 

1.0000 

(1) 

0.8430 

(1) 

F- 

0.60 

PaO 

.69917(1) 

0.6309 

(1) 

0.8276 

(1) 

0.8400 

(1) 

0.8705 

(1) 

0.5780 

(1) 

0.1944 

0.16(1) 

0.7822 

0.14(0) 

0.8355 

0.06(0) 

0.8609 

0.32(0) 

0.5006 

0.01(1) 

0.1448 

0.00(1) 

0.0562 

0.08(1) 

0.1129 

0.86(1) 

0.0452 

0.00(1) 

0.4118 

0.06(0) 

0.5498 

0.05(0) 

0.3463 

1.02(1) 

0.3828 

0.93(1) 

0.5745 

1.28(1) 

0.3965 

0.16(1) 

0.5890 

0.03(1) 

0.6913 

0.60(1) 

0.9333 

1.57(1) 

0.4149 

0.27(0) 

0.9005 

1.85(1) 

0.7897 

0.05(1) 

P-VALtJISC  0.100,  0.110)  Ol  TOLE8ANCI  IMSDFPICIBNT  FOR  FURTHIR  STIPPUKI 
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StAMARY  TABLE 


STIP 

VARIABLE 

MULTIPLE 

CHANGE 

P-VALOE 

P-VALUE 

NO. OF  VAR 

NO. 

1 

ENTERED 

REMOVED 

R 

RSQ 

IN  RSQ 

ENTER 

REMOVE 

INCLUDED 

1 

9 

NOECPS 

0.7793 

0.6073 

0.6073 

0.00 

1 

2 

10 

PLPRESCH 

0.8996 

0.8093 

0.2020 

0.00 

2 

3 

SO 

MMOECPSl 

0.9438 

0.8908 

0.0815 

0.00 

3 

4 

SIT 

STBCHDEF 

0.9673 

0.9356 

0.0448 

0.03 

6 

40 

TECRDEFl 

41 

TECMDEF2 

42 

TECHDEF3 

5 

17 

NOOIOS 

0.9764 

0.9534 

0.0178 

0.03 

7 

SBRIAL  CCkABLATIOM 

-0.1216 

DORBIN-MATSON  STATISTIC  2.2353 

;  based 

CM  23 

1  CASES 

CASE  PLOTS 

RESIDUALS 

LEVERAGE 

INFLUENCE 

CASE  LABEL 

STRSSID 

- 

LOG  P(H) 

MODCOOK 

NO. 

-4 

-2 

0 

2 

4 

0 

1 

2 

3 

4 

0  1 

2  3  4 

5 

6 

•f  .  . 

.  + 

>.  . 

.  .  4 

♦  . 

........ 

+  .  . 

+  ,  ,+ 

+  . 

.  4 

1 

** 

***•4 

*** 

2- 

M 

M 

H 

3 

*9 

»««*« 

*** 

4- 

M 

M 

M 

5 

# 

«#««** 

# 

6 

** 

** 

7 

«« 

** 

8 

« 

9 

« 

«*« 

** 

10- 

M 

N 

M 

11 

« 

« 

12 

«#««« 

« 

r*« 

13 

•  ««« 

*** 

14 

• 

** 

15 

** 

16 

* 

#** 

17 

** 

♦  ♦ 

18- 

M 

M 

M 

19 

* 

♦  # 

20 

21- 

M 

M 

M 

22 

* 

23 

24- 

M 

M 

N 

25 

♦  ** 

26 

«* 

•  * 

27 

* 

♦  ♦♦♦I 

28 

•  ** 

«•* 

29 

♦ 

.  .+ 

4- .  . 

.  .♦ 

+  .  .  . 

,+ 

♦  •  . 

.  .  -f 

+  .  .+ 

.+. 

4- , 

.+ 

-4 

-2 

0 

2 

4 

0 

1 

2 

3 

4 

0  1 

2  3  4 

5 

6 
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-111  111  1 
0.  +11  1  21  1  1  11  1+ 

.  + . + . + . ♦ . + . + . ♦ . + . + . 

3.  9.  IS  21 

0.  S.  12  18  24 

OCOSTCD  5 

EXTREME  CASES  -- 

CASE  NO.  COOK  CASE  NO.  OCOSTCD 

23  0.7352  17  25.7384 

27  0.4262  25  20.7504 


EXTREME  CASES  IN  THE  PLOTS  -- 


STATISTICS 

EXTREME 

VALOR 

NO. 

CASE 

LABEL 

WBIOHT 

3 

SCHEDMOD 

17 

NOOIDS 

COOK 

0.7352 

23 

1.0000 

46.8000 

39.0000 

COOK 

0.4262 

27 

1.0000 

64.2000 

58.0000 

CASE 

9 

10 

40 

41 

NO.  LABEL 

NOECPS 

PLPRBSCH 

TECKOEFl 

TECHDRF2 

23 

19.0000 

0.0000 

1.0000 

0.0000 

27 

28.0000 

1.0000 

0.0000 

0.0000 

CASE 

42 

50 

NO.  LABEL 

TBCHDBP3 

MNOECPSl 

23 

0.0000 

19.0000 

27 

0.0000 

28.0000 

41. 
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•h  «  O  X  M  M  CU  H  U  H  M  Q  XO 


OITRIIIDBD  NORMAL  PROBABILITY  PLOT  OP  OHNBIQHTBD  RBSIDOALS 
. + . + . + . ♦ . ♦ . ♦.  .  . 


D 

I 

V 

I 

A 

T 

I 

0 

N 


.4  > 


.2  > 


0.  ♦ 


-.2  + 


.  * 

.4  + 


.  + . + . ♦ . ♦ . + . + . +  . 
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aMNBZaHTBD  LIKST  SQOMISS  LIMUR  RBGRSSSIOM  OF  SCHBDPn  (HITHOOT  INT8SACTION  TBHMS) 
MtIDZCTOR 


VARZABLBS 

COBFFICZBMT 

STD  ERROR 

STUDENT'S 

T  P 

VZF 

COMSTAHT 

-16.9593 

31.6250 

-0.54 

0.5983 

PLTRZSKl 

143.126 

32.8045 

4.36 

0.0004 

1.3 

PLTRZSIC2 

-29.9876 

27.2668 

-1.10 

0.2859 

1.6 

NOBCPS 

1.97563 

0.54365 

3.63 

0.0019 

1.3 

PLCOHC 

60.7526 

25.2687 

2.40 

0.0272 

1.4 

PLSRZSKl 

-80.3199 

38.4366 

-2.09 

0.0511 

1.4 

PLSRZSK2 

10.6096 

26.9803 

0.39 

0.6988 

1.6 

R-SQOARBO 

0.6782 

RBSZD. 

MEAN  SQUARE 

(MSB)  2872.19 

ADJUSTED  R-SQUARED  0.5709 

STANDARD  OBVZATZCRI 

53.5928 

SOURCE 

OF  SS 

MS 

F 

P 

RXGRBSSZOM 

6  1.089B-t'05 

18156.1  6.32 

0.0010 

RESZDUAL 

18  51699.4 

2872. 

19 

TOTAL 

24  1.606E-f05 

C»SBS  ZMCLODBO  25  MZSSZMO  CASES  4 


STBPWZSB  AMALYSZS  OF  VARZAHCB  OF  SCHEDPER  {WZTHOOT  ZMTERACTZON  TERMS) 


SOURCE 

INDIVIDUAL 

SS 

CUM 

DF 

CUMULATIVE 

SS 

CUMULATIVE 

MS 

ADJUSTED 

R- SQUARED 

MALLOWS' 

CP 

P 

CONSTAMT 

l.ZSZE't'OS 

PLTRZSKl 

49598.2 

1 

49598.2 

49598.2 

0.2787 

17.7 

2 

PLTRZSX2 

0.06035 

2 

49598.3 

24799.1 

0.2459 

19.7 

3 

NOBCPS 

30370.8 

3 

79969.1 

26656.3 

0.4261 

11.1 

4 

PLCOHC 

12861.0 

4 

92830.2 

23207.5 

0.4935 

8.6 

5 

PLSRZSKl 

15662.4 

5 

1.085B4'05 

21698.5 

0.5900 

5.2 

6 

PLSRZSK2 

444.143 

6 

1.089B-t-05 

18156.1 

0.5709 

7.0 

7 

RESIDUAL 

51699.4 

24 

1.606B-f05 

6693.17 

R-SQUARED  0.6782  RBSZD.  MBAH  SQOARB  (MSB)  2872.19 

ADJUSTED  R-SQOARED  0.5709  STANDARD  DEVZATZON  53.5928 


VARZANCB-COVARZANCB  MATRZX  FOR  COBFFZCZEMTS 


COHSTANT 

PLTRZSKl 

PLTRZSK2 

NOBCPS 

PLCONC 

PLSRZSKl 

CONSTANT 

1000.14 

PLTRZSKl 

-444.135 

1076.13 

PLTRZSK2 

-223.395 

279.603 

743.479 

NOBCPS 

-11.5563 

2.12058 

-0.64370 

0.29555 

PLCOHC 

-377.294 

141.943 

-44.8518 

5.88273 

638.507 

PLSRZSKl 

-411.816 

-43.8426 

170.609 

2.10021 

-191.776 

1477.37 

PLSRZSK2 

-290.849 

36.1431 

-286.860 

0.49991 

-87.7186 

329.115 

PI.SRZSK2 

-0  PI.SRZSX2  727.936 


L-1 


ranniaHTiD  IiIast  sqomibs  lzmbar  rborbssicn  of  schsomod  (nithoot  iiitbractioh  terms) 


PREDICTOR 

VMIZABLBS  COEPPICIEMT  STD  ERROR  STODENT'S  T  P  VIP 

COHSTMIT  16.2539  13.4217  1.31  0.3093 

NOECPS  1.86091  0.13332  13.97  0.0000  1.3 

PLMESCH  -58.1340  7.51484  -7.73  0.0000  1.1 

TBCBDEFl  -14.2836  8.30555  -1.72  0.1048  1.8 

TECHDSFS  -9.38133  9.67674  -0.97  0.3467  1.8 

TECBDEP3  31.6173  7.88136  2.74  0.0144  1.9 

NODIDS  0.44186  0.15135  2.92  0.0100  1.3 

R-SQORRED  0.9408  RE8XD.  MEMI  SQOMtE  (NSE)  167.876 

ADJI»TED  R-SQORRED  0.9186  STMBMRD  DEVZATIOH  12.9567 

SOURCE  DP  SS  MS  P  P 

RBORESSIOH  6  42686.4  7114.41  42.38  0.0000 

RESZDORL  16  2686.02  167.876 

TOTAL  33  45373.5 

CASES  INCLUDED  23  MISSING  CASES  6 


STEPMISB  ANALYSIS  OP  VARIANCE  OP  SCHEDM(»  (WITHOUT  ItITERACTIOM  TERMS) 

INDIVIODAL  COM  CUMOLATIVB  CUMULATIVE  ADJUSTED  ddJOHS' 
SOURCE  SS  OP  SS  MS  R-SQOARBD  CP  P 

CONSTANT  59741.4 

NOECPS  37555.7  1  27555.7  27555.7  0.S886  87.1  2 

PLPRESCR  9163.49  2  36719.2  18359.6  0.7902  34.5  3 

TECHDEFl  1544.15  3  38263.3  12754.4  0.8186  27.3 

TBCHDEP2  640.168  4  38903.5  9725.89  0.8257  25.5 

TECHDEP3  2350.14  5  41353.7  8350.74  0.8825  13.5 

NODIDS  1433.77  6  42686.4  7114.41  0.9186  7.0 

RESIDUAL  2686.02  22  45372.5  2062.38 

R-SQUARBD  0.9408  RBSID.  MEAN  SQUARE  (MSB)  167.876 

ADJUSTED  R-SQOARED  0.9186  STANDARD  DEVIATION  12.9567 


VARIANCE-COVARIANCE  MATRIX  FOR  COEPPICZEMTS 


CONSTAMT 

NOECPS 

PLPRESCH 

TECHDEFl 

TBCHDBF2 

TBCHDBP3 

CCaiSTANT 

154.300 

NOECPS 

-0.70369 

0.01775 

PLPRESCH 

-45.6500 

-0.08025 

56.4728 

TECHDEFl 

-18.8014 

-0.29979 

8.14800 

68.9822 

TECHDEP2 

10.1476 

-0.14844 

-12.6053 

39.0730 

93.6394 

TECHDEP3 

-15.0161 

0.10656 

-6.08859 

34.2265 

43.3452 

62 . 1142 

NWZDS 

-1.31369 

0.00531 

0.05670 

-0.26061 

-0.60232 

-0.34294 

NODIDS 

NODIDS  0 . 02287 


lA  ^ 


DMNBZGHTID  UOST  SQOARBS  LZHIMI  RIOUSSION  OF  SCBKDPKIl  (WITH  IMTBtACTKSN  TIRMS) 


PRBDZCTOR 

VARZABLBS 

COBFFICIBNT 

STD  BRROR 

STUDENT'S 

T  P 

VIF 

COMSTAMT 

150.083 

39.2945 

5.12 

0.0001 

MPRBSCH3 

-109.643 

36.2429 

-4.18 

0.0005 

1.5 

somoisp 

-120.399 

30.8828 

-3.90 

0.0009 

1.7 

NOBCPS 

1.28483 

0.48491 

2.65 

0.0154 

1.0 

MSONSniT 

73 . 0910 

31.5710 

2.32 

0.0313 

2.1 

R-SQOARBD 

0.6399 

RBSZD.  NBAM  SQaARB 

(MSB)  2892 

.45 

ADJDSTBD  R-SQOARBD  0.5678 

STANDARD  DEVIATION 

53.7815 

SOORCB 

DF  SS 

NS 

F 

P 

RB6RBSSI0N 

4  1.028B-f05 

25696.7 

8.88 

0.0003 

RBSIOOAL 

20  57849.1 

2892.45 

TOTAL 

34  1.606B>05 

CASBS  IMCLODBD  35  MISSIMO 

CASBS  0 

STBPHISB  ANALYSIS  OF  VARIANCE  OF  SCRBDPBR 

(WITH  INTBRACTION  TBRMS) 

IMDIVIDOAL  COM 

COMOLATZVB 

CUMOLATIVB  ADJUSTED 

MALLOWS' 

SOORCB 

SS  OF 

SS 

MS 

R-SQUARBD 

C» 

P 

CONSTANT 

1.3S3B>0S 

MPRBSCH3 

40091.1  1 

40091.1 

40091. 1 

0.2170 

20.7 

2 

SONSOISP 

29642.0  3 

69733.1 

34866.5 

0.3827 

12.4 

3 

NOBCPS 

17550.8  3 

87384.0 

29094.6 

0.4781 

8.4 

4 

MSOHSINT 

15503.0  4 

1.028R>05 

25696.7 

0.5678 

5.0 

5 

RBSIOOAL 

57849.1  34 

1.60(B4-05 

6693.17 

R-SaOMtKD  0.(399 

AOJUSTXO  R-SQOARBD  0.5670 


RBSZD.  KUN  SQOARE  (MSB) 
STMIDMO)  DBVIATIGM 


3092.45 

53.7815 


VARIAMCB-COVRRIANCB  MATRIX  FOR  COBFFICIBMTS 


CONSTANT 

MPRESCH3 

SOHSDISP 

NOBCPS 

NSOWSINT 

CONSTANT 

858.173 

MPRBSCH3 

-409.648 

688.691 

SOHSDISP 

-566.140 

293.424 

953.750 

NOBCPS 

-7.20078 

0.55012 

•0.50326 

0.23514 

MSONSINT 

225.772 

-461.203 

•614.920 

1.28978 

996.733 

OORBIM-HRTSON  TBST  FOR  AOTOCORRELATION 
DDRBIM-MATSOM  STATISTIC  2.3037 

P-VALOBS,  OSmS  DORBIH-WATSOI'S  BBTA  APPROXIMATIOI : 

P  (POSITIVE  CORR)  «  0.5068,  P  (NBGATTVB  CORR)  -  0.4932 

BXPBCTBD  VALOE  OF  OORBIM-HATSON  STATISTIC  1.9892 
BXACT  VARZAMCB  OF  OORBIN-MATSOI  STATISTIC  3.78953 

CASBS  INCLODBD  25  MISSIMQ  CASBS  0 


OMMiaRriD  unsT  soomis  lzhsmi  skmssioh  of  scsmpn  (with  urmtACTioH  tiims,  cksi  *24 
ncuMD) 


tUDZCTOR 

VMIZMU8  CtmmClMKX  STD  mOfl  STODIMT'S  T  P  VIP 


OOMTAHT 

113 

t.65S 

24 . 7783 

4.55 

0.0002 

NPRISCR3 

-85. 

5379 

31.3239 

-4.01 

0.0007 

l.S 

SOMBDZSP 

•84. 

2546 

25.7740 

-3.27 

0.0040 

1.7 

HCWCf 

1.23127 

0.37633 

3.35 

0.0043 

1.0 

MBOMiZMT 

56. 

3629 

34.8740 

2.27 

0.0353 

3.1 

R-SQQAUD 

0.6366 

RBSZO. 

NIAH  SgOARI 

(MSB)  1738.58 

ADJDSTBD  R-SgOARID 

0.5479 

STAMDARD  OBVZATZQH 

41.6963 

SOORCB 

OF 

SS 

NS 

F 

P 

RIQRBSSZCH 

4 

55434.8 

13856 

.2  7.97 

0.0006 

RBSZDOAL 

19 

33033.1 

1738. 

58 

TOTAL 

23 

88457.9 

CASBS  ZMOiOOBD  34 

MZSSZHO  CASBS  1 

STBPWZSB 

ANALYSIS  OF 

VARZAMd 

OF  SCRBDPBR  (NZTR  HmRACTZON  TBRMS, 

CASB  *24 

IXCLODID) 

ZMDZVZOOAL 

COM 

CmOLATZVB 

COMOLATZVB 

ADJDSTBD  MALLONS' 

SOORCB 

SS 

OF 

SS 

MS 

R-SQOARBD 

CP 

P 

C0H8TAMT 

85834.9 

MPRBSCR3 

30215.4 

1 

20215.4 

20315.4 

0.1935 

19.3 

2 

SONSDZSP 

10086.8 

2 

30302.3 

15151.1 

0.2799 

15.4 

3 

NOBCPS 

16195.8 

3 

46498.1 

15499.3 

0.4545 

8.1 

4 

NSONSZHT 

8926.70 

4 

55424.8 

13856.2 

0.5479 

S.O 

5 

RISZODAL 

33033.1 

33 

.  88457.9 

3845.99 

R-SQOARBD  0 

.6266 

RBSZO.  NIAH  SQOARB  (MSB)  1738.58 

ADOOSTBO 

r-s<kiarbd  0 

.5479 

STAMDARD 

OlVZATZOH 

41.6963 

VmZMICI-COVMllAMCI  MATRIX  FOR  COIFFICZSNTS 


coMSTAirr 

HPRISCH3 

SOMSOISP 

NOICPS 

MSONSXMT 


COHSTMIT 

613.967 

-309.438 

-434.808 

-4.161S6 

179.570 


MPRBSCR3 

454.666 

337.343 

0.33333 

-305.469 


SONSDISP 


664.300 

-0.46300 

-411.857 


NOBCPS 


0.14163 

0.84974 


Msowsiirr 


618.717 


PRIDZCTBD/FZTTID  VALOIS  OF  SCRDPIR  (WZTH  ZHTIRACTZON  TBRMS,  CASI  824  1X0.0010) 


LOWIR  PRSDZCnO  BOOHD 
PRXDZCTB)  VALOS 
OPPBR  PRIDZCTID  BOOHD 
SB  (PRBDZCTBD  VALOB) 

QHD80ALHBS8  (LBVBRAOB) 
PIRCIHT  COVBRAOB 
C0RRB8P0HDZMS  T 

PRBDZCTOR  VALOIS:  MPRBSOO 
N80NSZHT  -  0.0000 


30.155 

LONIR  FZTTBD  BOOHD 

91.674 

155.40 

FZTTBD  VALOB 

155.40 

390.64 

OPPBR  FZTTBD  BOOHD 

219.12 

47.272 

SB  (FZTTBD  VALOB) 

33.274 

0.2854 

99.0 

3.86 

-  0.0000.  SONSDZSP  -  0.0000,  MOBCPS  -  35.000, 


F 


L-4 


OmiXWTID  LEAST  SQOARES  LIEBAR  RBCatBSSIOM  OP  SCHlDPSIt  (MITH  IirmtACTiail  TERMS,  CASE  *24 
AMD  CASE  *21  EXCLUDED) 

PREDICTOfl 


VARIABLES 

COBPPZCIEHT  STD  ERROR 

STODEMT'S 

T  P 

VIP 

COHSTAMT 

54.0412 

15.4390 

3.50 

0.0036 

MPRBSCH3 

-53.7854 

12.1397 

-4.35 

0.0004 

1.7 

SOHSDZSP 

-36.9013 

15.1335 

-3.44 

0.0353 

1.9 

NCHKPS 

1.42425 

0.20025 

7.11 

0.0000 

1.0 

MSONSIMT 

35.6783 

13.4305 

.  3.66 

0.0160 

2.1 

R-SQQAEED 

0.8087 

RESZO. 

MEAN  sgOARB 

(MSB)  483.396 

ADJUSIED  R-SQOARBD  0.7661 

STANDARD  DEVZATIOH 

31.9612 

SOORCB 

OP  as 

NS 

r 

P 

RMORESSIOH 

RESZOOAL 

TOTAL 

4  36691.1 
18  8681.33 
33  45373.5 

9173 

482.: 

.79  19.03 

296 

0.0000 

CASES  XMCLODED  23  MISSZHS  CASES  2 


STSSWZSE  AMALYSZS  OP  VARIANCE  OP  SCHEDPER  (WITH  ZHTERACTIOII  TERMS,  CASE  #24  AMO  CASE  #21 
EXCLODED) 

ZMDZVZOUAL  COM  CDMDLATZVE  CtMOLATZVS  ADJUSTED  MALLOMS' 


SOORCB 

SS 

DP 

SS 

MS 

R- SQUARED 

CP 

P 

OOHSTAm 

59741.4 

MPRB8CH3 

8811.88 

1 

8811.88 

8811.88 

0.1558 

56.8 

2 

SONSDZSP 

1034.05 

2 

9835.93 

4917.96 

0.1385 

56. 7 

3 

MOECPS 

33446.5 

3 

33382.5 

11094.1 

0.6915 

10.1 

4 

MSONSIMT 

3408.67 

4 

36691.1 

9172.79 

0.7661 

5.0 

5 

RBSZOOaU. 

8681.33 

33 

45373.5 

3063.38 

R-SODARED  . 

0.8087 

RBSID.  MEAN  SQUARE  (MSB)  482.296 

ADJUSTED  R-SgUARED 

0.7661 

STANDARD  DEVZATIOH 

21.9612 

VARIAMCE-COVARXAMCX  MATRIX  FOl  COEPPICIEMTS 

COHSTAMT  MPRESCH3  SOHSDZSP  NOBCPS  MSOWSINT 
CONSTAMT  238. 3S3 

NPRESCB3  -123.882  147.373 

SONSDZSP  -175. S90  96.5300  .  238.691 

MOECPS  -1.39008  0.19363  0.06192  0.04010 

MSON8ZMT  73.8263  -98.1569  -133.651  0.15257  180.110 


PREDZCTED/PITTSD  VALDES  OP  SCHEDPER  (WITH  ZHTERACTICN  TERMS,  CASS  #34  AMD  CASE  #21 
EXCLODED) 


LONER  mXDICTED  BOOMD 
PREDICTED  VALUE 

UPPER  PREDICTED  BOtWD 

SE  (MtEDZCTED  VALUE) 

29.245 

103.89 

178.53 

35.932 

LONER  PITTED  BOUND 
PITTED  VALUE 

UPPER  PITTED  BOUND 

SE  (PITTED  VALUE) 

64.194 

103.89 

143.58 

13.790 

OHUSDALMBSS  (LEVERAGE) 
PERCENT  COVERAGE 
CORRESPOHDIMG  T 

0.3943 

99.0 

2.88 

raSDZCTOR  VALDES:  MPRSSCR3  -  0.0000,  SONSDZSP  •  0.0000,  MOECPS  -  35.000, 
MSONSIMT  -  0.0000 


PMDZCTID/riTTSD  VJUJJIS  OF  SCHIDPER  (WITH  IMTBtACTKW  TERMS,  CASE  »24  AMD  CASE  «21 
EXCLUDED) 


LOWER  PREDICTED  BOCMD 
PREDICTED  VALOE 

OPPER  PREDICTED  BOOMD 

SE  (raEDICTED  VALOE) 

1.4X40 

7S.829 

152.24 

2S.200 

LOWER  PITTED  BOOMD 
FITTED  VALOE 

OPPER  FITTED  BOOMD 

SE  (FITTED  VALOE) 

35.702 

7S.829 

117.95 

14.288 

OmiSaALRESS  (LEVERAGE) 
PERCEMT  COVERAGE 
CORRESPOHDim  T 

0.4233 

99.0 

2. at 

PREDICTOR  VAUIES)  NPRESCH3  -  0.0000,  SOHSDISP  >  0.0000,  MOECPS  -  IS. 000, 
MSONSIMT  -  0.0000 


OUKOHIM)  LUST  SQOAItlS  LIMUR  RBOSSSSIOH  OF  SCHBCMOD  (WITH  IHTUIACTIOM  TBRMS) 
FUDZCTQR 


VARIABLES 

COKFFICIEIR  STD  ERROR 

STDDRMT'S 

T  P 

VIF 

COaSTAMT 

35 

.0189 

10.0748 

3.48 

0.0025 

NCnCFS 

1.! 

58554 

0.14722 

10.77 

0.0000 

1.0 

FLFRS8CH 

-45 

.7239 

9.02245 

-5.18 

0.0001 

1.0 

MK»CF81 

1.: 

18851 

0.31558 

3.77 

0.0013 

1.1 

R-SQOARBD 

0.8908 

RUZD.  MEAN  SQOARK 

(MSS)  250.772 

ADJUSTED  R-SQOARSD 

0.8735 

STAMDARD  1 

DEVZATIOH 

15 . 1484 

SODRCE 

DF 

SS 

MS 

F 

P 

REORESSIOM 

3 

40417.8 

13472.5 

51.55 

0.0000 

RESIDOAL 

19 

4954.58 

250.772 

TOTAL 

22 

45372.5 

C3USIS  IMCLODD  23  NISSIHQ  CASKS  0 


STIFHZSI  AHALYSIS  OF  VARZAMCB  OF  SCHDMOD  (MZTH  mTKUCTION  TERMS) 


mDZVZOOAL 

COM 

CtRIDLATZVS 

CDNDLATIVS 

ADJUSTED 

MALLOWS' 

SOORCS 

SS 

DF 

SS 

MS 

R-SQOARED 

CP 

P 

CONSTAHT 

59741.4 

HOSCPS 

27555.7 

1 

27555.7 

27555.7 

0.5885 

49.3 

2 

PLPRSSCH 

9153.49 

2 

35719.2 

18359.5 

0.7902 

15.2 

3 

M80SCPS1 

3598.58 

3 

40417.8 

13472.5 

0.8735 

4.0 

4 

RESIDOAL 

4954.58 

22 

45372.5 

2052.38 

R-SODARED 

0 

.8908 

RSSID.  MEAN  SQOARS  (MSS)  250 

.772 

ADJD8TSD 

R-SQOARKD  0 

.8735 

STANDARD 

DEVZATIOH 

15. 

1484 

VARIANCE- 

COVARIANCE  MATRIX  FOR  COEFFICIENTS 

CONSTANT 

NOSCPS 

PLntSSCH 

MNOBCPSl 

COHSTANT 

101.501 

NOSCPS 

-0.70451 

0.02157 

PLPRSSCH 

-71.9495 

0.03194 

81.4047 

MHOKCPSl 

-1.38104 

0.00739 

0.49753 

0.09959 

OOtBXH-NATSQH  TBST  FOl  ADTOCORRKLATICN 

DORBIM-NATSail  STATISTIC  3 . 105« 

tXPBCTID  VALOS  OF  DOUIM-KATSOM  STATISTIC 
EXACT  VARIAMCB  OF  DaRBIM'MATSOH  STATISTIC 

CASES  nCLDDSD  23 


MISSINS  CASKS  0 


1.97S9 

5.17872 


amniGHTID  least  squares  LIMBAR  RBQRESSION  of  SCHSDMOD  (WITH  XHTBRACTICR)  TERMS,  CASE  *23 
EXCLOMD) 

PREDICTOl 


VARIABLES 

COEFFICIENT 

STD  ERROR 

STUDENT'S 

T  P 

VIF 

CONSTANT 

48 

.3890 

8.28701 

5.84 

0.0000 

NOECPS 

1. 

55274 

0.11089 

14.00 

0.0000 

1.0 

PLntBSCH 

-60 

.0973 

7.57237 

-7.94 

O.OOOC 

1.0 

MI0BCP81 

1. 

3293S 

0.23970 

5.55 

0.0000 

1.0 

R-SQUARED 

0.9416 

RBSXO.  MEAN  SQUARE 

(MSB)  147.134 

ADJUSTED  R-SQUARED 

0.9319 

STANDARD 

DEVIATION 

12 . 1299 

SOURCE 

OF 

SS 

NS 

F 

P 

REGRESSION 

3 

42705.9 

14235.3 

96.75 

0.0000 

RESIDUAL 

18 

2648.42 

147.134 

TOTAL 

21 

453S4.3 

CASES  INCLUDED  22  MISSINQ  CASES  1 


STEPWISE  ANALYSIS  OF  VARIANCE  OF  SCHBDNOD  (WITH  INTERACTION  TERMS,  CASE  *23  EXCLUDED) 


SOURCE 

INDIVIDUAL 

SS 

CUM 

DF 

CUMULATIVE 

SS 

CUMULATIVE 

MS 

ADJUSTED 

R-SQUARED 

MALLOWS' 

CP 

P 

CONSTANT 

57569.3 

• 

NOECPS 

27649.8 

1 

27649.8 

27649.8 

0.5901 

102.3 

2 

PLPRBSCH 

10530.8 

2 

38180.7 

19090.3 

0.8252 

32.8 

3 

MNOECPSl 

4525.19 

3 

42705.9 

14235.3 

0.9319 

4.0 

4 

RESIDUAL 

2648.42 

21 

45354.3 

2159.73 

R- SQUARED 

0. 

.9416 

RBSID.  MEAN  SQUARE  (MSB)  147 

.134 

ADJUSTED  R-SQUARED  0. 

.9319 

STANDARD  DEVIATICO) 

12. 

1299 

VARIANCE-COVARIANCE  MATRIX  F(»  COEFFICIENTS 


CONSTANT 

HOBCPS 

PLPRBSCH 

MNOECPSl 


CONSTANT 

68.674S 

•0.42S62 

-S2.0032 

-0.6S908 


NOECPS 

0.01229 

0.04609 

0.00387 


PLPRBSCH 

57.3408 

0.16055 


MNOECPSi. 


0.05745 


PREDICTED/FITTED  VALUES  OF  SCHBDNOD  (WITH  INTERACTION  TERMS,  CASE  *23  EXCLUDED) 


LOWER  PREDICTED  BOUND 

62.180 

LOWER  FITTED  BOUND 

81.717 

PREDICTED  VALUE 

103.14 

FITTED  VALUE 

103.14 

UPPER  PREDICTED  BOUND 

144 . 11 

UPPER  FITTED  BOUND 

124.58 

SE  (PREDICTED  VALUE) 

14.232 

SB  (FITTED  VALUE) 

7.4456 

UNUSUALNESS  (LEVERAGE) 

0.3768 

PERCENT  COVERAGE 

99.0 

CORRESPOHDIMQ  T 

2.88 

PREDICT(»  VALUES:  NOECPS 

>  19.000, 

PLPRBSCH  a  0.0000,  MNOECPSl  •  19 

L-8 


LSMT  fomiu  tniAK  saoKiuzoa  or  rcDDrn  (mgoil  i) 


miDicroR 

VMUABLIS 


coirrzczmT 


STD  BtitOR 


STUUIHT'S  T 


CGHsnun 

Moicrs 

PLPRBSCH 

TDIfM 


C4.82C7 

1.76779 

-96.5361 

61.5823 


36.8685 

0.59580 

32.3203 

37.3298 


0.0933 

0.0074 

0.0060 

0.0345 


R-SQOMtlD  0.4714 

ADJOSTBD  R-SOOMtlD  0.3959 

SOORCB  or  88 


RtSZO.  MIMI  SQORRI  (MSI) 
STMDARO  DIVZATZCH 


4043.18 

63.5860 


RIGRISSZOH 

RBSZDORX. 

TOTAL 


75729.2 

84906.9 

1.606l>05 


25343.0 

4043.18 


6.24  0.0034 


STIFMISI  AMALY8Z8  OF  VARZAMCI  OF  SCHIDPIR 

ZHDZYIDOAL  COM  COMDLATZVI  COMDLATZVS  AOJDSTID  KALLOMS 
SOORCS  88  DF  88  NS  R-SQOARID  CP 


(XRISTANT 

1.3531-405 

NOICPS 

34869.9  1 

24869.9 

24869.9 

0.1181 

PLPRSSCH 

30179.5  2 

55049.5 

27524 . 7 

0.3839 

TDIFM 

20679.6  3 

75729.2 

25243.0 

0.3959 

RSSIOOAL 

84906.9  24 

1 

.6061-405 

6693.17 

R-SQOARID 

0.4714 

RISZD.  MSAH  SQOARI  (MSS)  4043.18 

ADJOSTID  R-SQOARSD  0.3959 

STANDARD  DSVZATION 

63.5860 

OMNBZaBTSD  LIAST  SQOAISS  LINSAR 

RSaRBSIZON  OF  8CBSDPSI 

(MOOSL  3) 

PRSDICTOR 

VARZABLSS 

COSFFICIINT 

STD 

IRROl 

STDDINT'S  T 

P 

CONSTANT 

N08CPS 

PLPRSSCH 

PLND8V 


134.519 

1.56298 

-73.5726 

-64.9264 


37.1477 

0.58488 

32.9285 

31.2153 


0.0016 

0.0143 

0.0365 

0.0500 


R-SQOARID  0.4550 

AOJDSTID  R-SQOARID  0.3771 

SOORCS  OF  SS 


RISZD.  MIAN  SQOARS  (MSS) 
STANDARD  DSVZATION 


4169.06 

64.5682 


RIQRSSSION 

RSSZDOAL 

TOTAL 


73085.8 

87550.3 

1.60614-05 


34361.9 

4169.06 


5.84  0.0046 


STIPNISS  ANALYSIS  OP  VARIANCI  OF  SCHIDPIR 


SOORCI 


INDZVZOOAL  CON  COMOLATIVI  CDMOLATIVI  ADJOSTID  MALLOWS 
SS  DF  SS  MS  R-SQOARID  CP 


CONSTANT 

NOICPS 

PLPRSSCH 

PLNDSV 

RSSZDOAL 


l.SSZS-t-OS 
24869.9 
30179.5 

18036.3 

87550.3 


34869.9 

55049.5 

73085.8 

1.6061-405 


24869.9 
27524.7 

34361.9 
6693.17 


0.1181 

0.2829 

0.3771 


R-SQOARSD  0.4550 

ADJOSTID  R-SQOARSD  0.3771 


RISZD.  MIAN  SQOARI  (MSI) 
STANDARD  DSVZATION 


4169.06 

64.5682 


M-1 


aMNBZONTBB 

PRBDZCTOR 

VARZABLBS 

1  LBAST  MVUtBS  LZHBAB  BBORBSSION  OP  SCBBDPBB  (MOOBL  3) 

COBPPICIBMT  STD  BRROR  STUDBNT'S  T  P 

VIP 

CCMSTANT 

54.7043 

33.3093 

1.69 

0.1052 

NOBCPS 

2.42202 

0.68534 

3.53 

0.0020 

1.4 

PLCONC 

70.3440 

32.1180 

2.19 

0.0399 

1.5 

PUSBV 

-110.233 

33.9764 

-3.24 

3.0039 

1.3 

R-SQOARBO 

0.4509 

RBSID.  MBAN  50QARB 

(MSB)  4200 

.62 

ADJDSTBD  R-SQDARBD  0.3724 

STANDARD  OBVIATION 

64.8132 

SOORCB 

OP  SS 

MS 

P 

P 

RB(3RBSSZ0H 

3  73423.1 

24141.0 

5.75 

0.0049 

RBSZDOAL 

31  88313.0 

4200.63 

TOTAL 

24  1.606B>05 

STBPWZSB  ANALYSIS  OP  VARIANCB 

OP  SCHBDPBR 

INDZVZDOAL  CON 

COMOLATZVB 

CmOLATIVB  ADJUSTBD 

MALLOWS' 

SOORCB 

SS  OP 

SS 

MS 

R-SQDARBD 

CP 

CONSTANT 

1.253B>05 

NOBCPS 

24869.9  1 

34869.9 

34869.9 

0.1181 

11.3 

PLCONC 

3344.29  2 

28214.3 

14107 . 1 

0.1007 

ir  .5 

PLNDBV 

44208.8  3 

72423.1 

34141.0 

0.3724 

4.0 

RBSZDOAL 

88213.0  24 

1.6068>0S 

6693.17 

R-SQOMIRD  0.4509 

ADJOSTSD  R-SQtmiBD  0.3724 


RBSID.  MBAH  SOOMtS  (MSB)  4200.62 
STANDARD  DBVXATXON  64.8X22 


UmiBICtBD  UAST  SVIARBS  LIWBAR  RBORBSSZOM  OW  SCBBDRBB  (MOOBL  4) 


msoicroR 


VARZABLBS 

COBPPICIBNT 

STD  BRROR 

STUDENT'S 

T  P 

VIP 

CONSTANT 

45.6835 

34.9665 

1.31 

0.2055 

NOBCPS 

2.05500 

0.62423 

3.29 

0.0035 

1.1 

PLMDBV 

-86.4554 

31.2762 

-2.76 

0.0116 

1.0 

TDBFM 

57.7631 

27.8827 

2.07 

0.0508 

1.1 

R-SQUARBD 

0 

1.4399 

RBSID.  MBAN  SQUARE 

(MSB)  4284 

.52 

ADJUSTBD  R-SQUARED  0 

.3599 

STANDARD  DBVIATI(»i 

65.4562 

SOURCE 

DF 

SS 

MS 

P 

P 

RBGRBSSI(»i 

3 

70661.3 

23553.7 

5.50 

0.0060 

RESIDUAL 

21 

89974.9 

4284.52 

TOTAL 

34  1. 

606B+05 

STBPNZ8B  ANALYSIS  OP  VARIANCE  OP  SCRBDPER 

INOrVZDUAL 

CUM 

OBtULATIVB 

OMOLATZVE  ADJUSTBD 

MALLONS' 

SOORCB 

SS 

DP 

SS 

MS 

R-SQUARBD 

CP 

CONSTANT 

1.2528+05 

NOBCPS 

24869.9 

1 

24869.9 

24869.9 

0.1181 

10.7 

PLNDBV 

27403.3 

2 

53273.3 

26136.6 

0.2641 

6.3 

TOBPM 

18387.8 

3 

70661.3 

23553.7 

0.3599 

4.0 

RBSZOUAL 

89974.9 

24 

1.606B+05 

6693.17 

R-SODARED  0.4399 

ADJUSTBD  R-SQOARBD  0.3S99 


RBSID.  MBAN  SQOARB  (MSB)  4284.52 
STANDARD  DBVZATION  65.4562 


M-2 


UMNIXamD  LEAST  SQOMSS  LTMSAS  UOUSSZOtl  OF  SOBDPn  (MODSL  S) 

raSDlCTOR 


VARIABLES 

COEFFICIENT 

STD  ERR(Ml 

STUDENT' S 

T  P 

VIF 

CONSTANT 

118.671 

36.7795 

3.23 

0.0040 

NOECPS 

1. 

74331 

0.65153 

2.68 

0.0142 

1.2 

PLFRESCH 

-86 

.9405 

33.6631 

-2.58 

0.0174 

1.0 

UCOSTCD 

-0. 

00309 

0.00203 

-1.52 

0.1430 

1.2 

R-S(^]ARED 

0.4080 

RESID. 

MEAN  SQUARE 

(NSE)  4528.65 

ADJUSTED  R'SVIARED 

0.3234 

STANDARD  DEVIATION 

67.2952 

SOURCE 

DF 

SS 

MS 

F 

P 

RECBtESSION 

3 

65534.3 

21844 

1.7  4.82 

0.0104 

RESIDUAL 

21 

95101.8 

4528. 

65 

TOTAL 

24 

1.606S>05 

STIPWZSB  ANALYSIS  OF  VARZAMCB  OF  SCHSDFBR 


SOURCE 

INDIVIDUAL 

SS 

CUM 

DF 

CUMULATIVE 

SS 

CUMULATIVE 

MS 

ADJUSTED 

R- SQUARED 

MALLOWS' 

CP 

P 

CONSTANT 

1.252E>0S 

NOECPS 

24869.9 

1 

24869.9 

24869.9 

0.1181 

9.0 

2 

PLPRESCH 

30179.5 

2 

55049.5 

27524.7 

0.2829 

4.3 

3 

UCOSTCD 

10484.8 

3 

65534.3 

21844.7 

0.3234 

4.0 

4 

RESIDUAL 

95101.8 

24 

1.606E'f05 

6693.17 

R. SQUARED 

0.4080 

RESID.  MEAN  SQUARE  (MSE)  4528 

.65 

ADJUSTED  I 

t- SQUARED 

0.3234 

STANDARD 

DEVIATICNI 

67.2952 

omnianR)  lust  sooasu  luoas  ssaussioii  of  scbsdfu  (modbl  o 


PRKDICTOR 

VARIABLBS  COBFFICIBMT  STD  BRROR  STODENT'S  T  B  VIF 


CONSTANT 

153.979 

49.6464 

3.10 

0.0054 

NOECPS 

1.03765 

0.64007 

1.62 

0.1199 

1.1 

PLFRESCH 

-87.4509 

33.7299 

-2.59 

0.0170 

1.0 

PLDRRFP 

-53.4515 

35.3280 

-1.49 

0.1506 

1.1 

R-SQaARED  0.4057  RESID.  MEAN  SQOARE  (NSE)  4546.10 

ADJUSTED  R-SQUARED  0.3208  STANDARD  DEVIATION  67.4248 

SOURCE  DF  SS  MS  P  P 

REGOtBSSICRI  3  6S167.9  21722.6  4.78  0.0108 

RESIDUAL  21  9S468.2  4546.10 

TOTAL  24  1.606E+05 

STEPWISE  ANALYSIS  OF  VARIANCE  OF  SCKBDPER 


SOURCE 

INDIVIDUAL 

SS 

CUM 

DF 

CUMULATIVE 

'SS 

CUMULATIVE 

MS 

ADJUSTED 

R- SQUARED 

MALLOWS' 

CP 

P 

COISTANT 

1.252S-»0S 

9 

NOECPS 

24869.9 

1 

24869.9 

24869.9 

0.1181 

8.9 

2 

PLPRESQ! 

30179.5 

2 

55049.5 

27524.7 

0.2829 

4.2 

3 

PLDRRFP 

10118.4 

3 

65167.9 

21722.6 

0.3208 

4.0 

4 

RESIDUAL 

95468.2 

24 

1.606S405 

6693.17 

R- SQUARED 

0. 

.4057 

RESID.  MEAN  SQUARE  (MSE)  4546 

.10 

% 

ADJUSTED  R-SQUARED  0.3208 

STANDARD 

DEVIATION 

67.4248 

OMHiXanB)  LEAST  SQOASBS  LZIBAR  UOSSSSKai  Or  8CBSDPIA  (MODIL  7) 


PRIOICTOR 


VARIABLES 

COEPPICIENT  STD  ERROR 

STUDENT' S 

T  P 

VIP 

constant 

18 

.4012 

51.6482 

0.36 

0.7252 

NOECPS 

1.1 

B6693 

0.63022 

2.96 

0.0074 

1.1 

PLHDEV 

-107.189 

36.9912 

-2.90 

0.0086 

1.4 

NOPMDIDS 

10 

.9694 

6.9SS08 

1.58 

0.1297 

1.3 

R-SQUARED 

0.3969 

RESID.  MEAN  SQUARE 

(MSE)  4613 

.64 

adjusted  R' 

-SQUARED 

0.3107 

STANDARD  DEVIATKEI 

67.9237 

SOURCE 

DP 

SS 

MS 

P 

P 

REGRESSION 

3 

63749.7 

21249.9 

4.61 

0.0125 

RESIDUAL 

21 

96886.4 

4613.64 

TOTAL 

24 

1.606E+OS 

STEPWISE  ANALYSIS  OP  VARIANCE 

OP  SCHEDPER 

INDIVIDUAL  CUM 

CUMULATIVE 

CUMULATIVE  ADJUSTED 

MALLOWS 

SOURCE 

SS 

DP 

SS 

MS 

R-SQUARED 

CP 

CCWSTANT 

1.2S2E-t.05 

NOECPS 

24869 

.9  1 

24869.9 

24869.9 

0.1181 

8.4 

PLNDEV 

27403 

.3  2 

52273.3 

26136.6 

0.2641 

4.5 

NOPMDIDS 

11476 

.3  3 

63749.7 

21249.9 

0.3107 

4.0 

RESIDUAL 

96886 

.4  24 

1.606E-t-05 

6693.17 

r.SQOARED  0.3969 

adjusted  R-SQUARED  0.3X07 


RESID.  MEAN  SQUARE  (MSE) 
STANDARD  DEVIATION 


4613. 64 
67.9237 


tnmSXCBTSD  least  squares  linear  REORESSXON  or  SCBEDPRR  (MODEL  8) 
PREDICTOR 


VARIABLES 

COEPPICIENT  STD  ERROR  STUDENT'S 

T  P 

VIP 

CXmSTANT 

114.399 

36.8017 

3.11 

0.0053 

NOECPS 

1.41375 

0.61029 

2.32 

0.0307 

1.0 

PLPRESCK 

-83.2141 

34.2178 

-2.43 

0.0241 

1.0 

PLTRM 

-35.9746 

27.4386 

-1.31 

0.2040 

1.0 

R- SQUARED 

0.3924 

RESID.  MEAN 

SQUARE 

(MSE)  4647.50 

ADJUSTED  R 

-SQUARED  0.3056 

STANDARD  DEVIATION 

68.1726 

SOURCE 

DP  SS 

MS 

F 

P 

RECNIESSION 

3  63038.4 

21012.8 

4.52 

0.0135 

RESIDUAL  21  97597.7  4647.50 

TOTAL  24  1.606S>05 

STEPWISE  ANALYSIS  OP  VARIANCE  OP  SCHEDPER 

INDIVIDUAL  CUM  CUMULATIVE  OmULATIVB  ADJUSTED  HALLOWS' 

SOURCE 

SS  •  DP 

SS 

NS 

R-SQUARED 

CP 

CONSTANT 

NOECPS 

1.252E4'05 

24869.9  1 

24869.9 

24869.9 

0.1181 

8.2 

PLPRESCR 

30179.5  2 

55049.5 

27524 . 7 

0.2829 

3.7 

PLTRM 

7988.94  3 

63038.4 

21012.8 

0.3056 

4.0 

RESIDUAL 

R- SQUARED 

97597.7  24 

0.3924 

1.606E^05 

RESID.  MEAN 

6693.17 

SQUARE 

(MSE)  4647.50 

ADJUSTED  R-SQUARED  0.3056 

STANDARD  DEVIATION 

68.1726 

V 


4 


rmmimtED  limt  sqouuu  bXMua  nauuazoii  or  scaiDPnt  $) 

rUOZCTQIl 


VARIABLES 

COEPriCIEHT  STD  ERR<» 

STUDENT’S 

T  P 

VIP 

COHSTAIIT 

Xlfl 

1.340 

37.9995 

3.11 

0.0052 

MOBCrS 

1.26755 

0.61530 

2.06 

0.0520 

1.0 

PLPRESCH 

-85. 

3134 

34.2287 

-2.49 

0.0211 

1.0 

sowsniT 

-34. 

9336 

27.7762 

-1.26 

0.2223 

1.0 

R-SQOARED 

0.3887 

RBSID.  MEAN  SQUARE 

(MSE)  4675.74 

ADJUSTED  R-SQUARED 

0.3014 

STANDARD  1 

DEVIATION 

68.3794 

SOURCX 

DP 

SS 

NS 

P 

P 

RKBtESSZOH 

3 

62445.4 

20815.1 

4.45 

0.0143 

RESIDUAL 

21 

98190.7 

4675.74 

TOTAL 

24 

1.606E-)-05 

STEPWISE  ANALYSIS  OP  VARIANCE 

OP  SCHEDPBR 

SOURCE 

INDIVIDUAL 

SS 

CUM 

DP 

CUMULATIVB 

SS 

OBIULATIVB 

MS 

ADJUSTED 

R- SQUARED 

MALLOWS' 

CP 

P 

CONSTANT 

1.2S2E-f0S 

NOBCPS 

24869.9 

1 

24869.9 

24869.9 

0.1181 

8.0 

2 

PLPRESCH 

30179.5 

2 

55049.5 

27524.7 

0.2829 

3.6 

3 

SOWSINT 

7395.92 

3 

62445.4 

20815.1 

0.3014 

4.0 

4 

RESIDUAL 

98190.7 

24 

1.606E-I-05 

6693.17 

R-SQUARED 

0.3887 

RBSID.  MEAN  SQUARE  (MSB)  4675 

.74 

ADJUSTED  R-SQUARED  0 

.3014 

STANDARD 

DEVIATION 

68.3794 

amnzffixcD  iduar  sa<nua  tznMt  uausszoa  or  scHsorn  (modil  xo) 

PRBOZCTOR 


VARIABLES 

COBPPICIENT  -  STD  ERROR 

STUDENT’S 

T  P  • 

VIP 

CCBISTAMT 

105.933 

35.7965 

2.96 

0.0075 

NOBCPS 

1. 

21498 

0.62267 

1.95 

0.0645 

1.0 

PLPRESCH 

-99.7938 

35.7865 

-2.79 

0.0110 

1.1 

PLAOGR 

42 

.1475 

34.0141 

1.24 

0.2290 

1.1 

R- SQUARED 

0.3875 

RBSID.  MEAN  SQUARE 

(MSE)  4685.36 

ADJUSTED  R-SQUARED 

0.3000 

STANDARD  DEVIATION 

68.4497 

SOURCE 

DP 

SS 

MS 

P 

P 

REGRESSKm 

3 

62243.5 

20747.8 

4.43 

0.0146 

RESIDUAL 

21 

98392.6 

4685.36 

TOTAL 

24 

1.606B>05 

STEPWISE  ANALYSIS  < 

OP  VARIANCE 

OP  SCHEDPBR 

f 


\ 


SOURCE 

INDIVIDUAL 

SS 

CUM 

DP 

CUMULATIVE 

SS 

CUMULATIVE 

MS 

ADJUSTED 

R- SQUARED 

MALLOWS’ 

CP 

P 

CONSTANT 

NOBCPS 

1.2S3B1-0S 

24869.9 

1 

24869.9 

24869.9 

0.1181 

8.0 

2 

PLPRESCH 

30179.5 

2 

55049.5 

27524.7 

0.2829 

3.5 

3 

PLAGOR 

7193 . 96 

3 

62243.5 

20747.8 

0.3000 

4.0 

4 

RESIDUAL 

98392.6 

24 

1.606B-»'05 

6693 . 17 

R-SQOMtBD  0.3875  RBSID.  MEAN  SQOARB  (MSB)  4685.36 

ADJUSTED  R-SQUARED  0.3000  STANDARD  DEVIATION  68.4497 


M-5 


aiwiiq«i«D  busT  somuuM  bznjut  uausioH  or  scnorn  (noon,  id 

PUDICTOR 


VARZABLBS 

COBPPICIBNT 

STD  BRR(» 

'  STUDENT'S 

T  P 

VIF 

CONSTANT 

97.8167 

34.7985 

2. 81 

0.0108 

NOSCPS 

2.03236 

0.53456 

3.80 

0.0011 

1.1 

ftjntlSCB 

-84.85S4 

28.8648 

-2.94 

0.0081 

1.1 

PLNDBV 

•72.1613 

27.2184 

-2.65 

0.0153 

1.1 

TOnM 

67.6387 

24.1101 

2.81 

0.0109 

1.1 

R-SQOAItlD 

0.6089 

RB8ZO. 

MBAH  SQOARB 

(MSB)  3141.34 

APJUSTBO  R-SQOARSD  0.S307 

STANDARD  DBVXATXON 

56.0477 

SOORCB 

OF  38 

MS 

F 

P 

RSORISSION 

4  97809.2 

24452 

1.3  7.78 

0.0006 

RISIDOAL 

20  62826.9 

3141. 

34 

TOTAL 

24  1.606B-i-05 

STIPNISB  JkHALYSZS  OP  VMUANCB  OF  SCBBDPBR 


SOORCB 

INDIVIDOAL 

SS 

COM 

OF 

CQMOLATIVB 

SS 

COMOLATIVB 

NS 

ADJUSTED 

R. SQUARED 

MALLOWS' 

CP 

P 

CONSTANT 

1.3S2B>0S 

NOBCPS 

24869.9 

1 

24869.9 

24869.9 

0.1181 

22.2 

2 

PLPRBSCH 

30179.5 

2 

55049.5 

27524.7 

0.2829 

14.6 

3 

PLMDBV 

18036.3 

3 

73085.8 

24361.9 

0.3771 

10.9 

4 

TDBFM 

24723.3 

4 

97809.2 

24452.3 

0.5307 

5.0 

5 

RBSIDOAL 

62826.9 

24 

1.60684-05 

6693.17 

R-SQOARBD 

0.6089 

RBSID.  MBAN  SQOARB  (MSB)  3141 

.34 

ADJOSTBD  R 

I-SOOARBD  0. 

5307 

STANDARD 

OBVZATICBI 

56.0477 

amazoRnD  lbast  satniis  uhbu  toKoauaxcm  or  scKKorn  (mqdki  la) 
ntBoiCTcm 


VARIABLES 

COBFFICIBNT  STD  BRRCHl 

STUDENT'S 

T  P 

VIF 

CCBISTAMT 

104 

>.386 

36.4825 

2.86 

0.0097 

NOBCPS 

2.30129 

0.62646 

3.67 

0.0015 

1.4 

PLPRBSCH 

-69. 

5015 

30.1612 

-2.30 

0.0321 

1.0 

PLOWC 

66.3152 

29.3080 

2.26 

0.0349 

1.5 

PLNDBV 

-95. 

5852 

31.5939 

-3.03 

0.0067 

1.3 

R-SQOARBD 

0.5661 

RBSID. 

MBAN  SQOARB 

(MSB)  3485.31 

ADJOSTBO  R-SQOARBD 

0.4793 

STANDARD  DEVIATION 

59.0365 

SOORCB 

DF 

SS 

NS 

F 

P 

RBORBSSION 

4 

90929.9 

22732 

:.4  6.52 

0.0016 

RBSIDOAL 

20 

69706.2 

3485. 

31 

TOTAL 

24 

1.606B-f05 

STBPHZSB  ANALYSIS  OF  VARIANCB  OF  SCKEDPKR 


SOORCB 

INDIVIDOAL 

SS 

COM 

DF 

COMOLATIVB 

SS 

COMOLATIVB 

MS 

ADJUSTED 

R-SQOARBD 

MALLOWS' 

CP 

P 

CONSTANT 

1.2528-405 

NOBCPS 

24869.9 

1 

24869.9 

24869.9 

0.1181 

18.0 

2 

PLntBSCH 

30179.5 

2 

55049.5 

27524.7 

0.2829 

11.3 

3 

PLCOHC 

3978.63 

3 

59028.1 

19676.0 

0.2771 

12.2 

4 

PLNDBV 

31901.7 

4 

90929.9 

22732.4 

0.4793 

5.0 

5 

RBSIDOAL 

69706.2 

24 

1.606B-405 

6693.17 

R-SQOARBO 

0.5661 

RBSID.  MEAN  SQOARB  (MSB)  3485 

.31 

ADJUSTED  R-SQOARBD 

0.4793 

STANDARD 

DEVIATION 

59.0365 

M-6 


qumiCBItlD  LUST  SQOMU  LZMUS  UOUSSZOd  Of  SCBDSU  (MODSL  13) 
PMDZCTat 


VARIABLES 

COEFFICIENT 

STD  ERR^ 

STUDENT' S 

T  P 

VIF 

CONSTANT 

71.3385 

35.3945 

2.02 

0.0575 

NOECPS 

1.70463 

0.56994 

3.99 

0.0072 

1.1 

PLPRE8CH 

-87.1714 

31.4416 

-2.77 

0.0117 

1.1 

PLMUN 

-45.7614 

26.2407 

-1.74 

0.0965 

1.2 

TDEIN 

72.9137 

36.7955 

2.72 

0.0132 

1.2 

R-SQQARED 

0.5413 

RESID. 

NEAN  SQOARB 

(MSB)  3685.00 

ADJDSTED  R-SQOARBD  0.4494 

STANDARD  DEVIATICH 

60.7042 

SOORCE 

DF  SS 

NS 

F 

P 

RECBIBSSICBI 

4  86936.1 

21734 

1.0  5.90 

0.0036 

RESIDOAL 

20  73700.0 

3685. 

00 

TOTAL 

34  1.606E«05 

STBPWIoS  ANALYSIS  OF  VARIANCE  OP  SCHBDPSR 


SOURCE 

INDIVIDUAL 

SS 

CUM 

DF 

CUMULATIVE 

SS 

CUMULATIVE 

MS 

ADJUSTED 

R- SQUARED 

MALLOWS' 

CP 

P 

CONSTANT 

1.252S-fOS 

NOECPS 

34869.9 

1 

34869.9 

24869.9 

0.1181 

15.8 

2 

PLPRBSCH 

30179.5 

2 

55049.5 

37524.7 

0.2829 

9.7 

3 

PLHL3M 

4601.12 

3 

59650.6 

19883.5 

0.2815 

10.4 

4 

TDEFM 

27285.4 

4 

86936.1 

31734.0 

0.4494 

5.0 

5 

RESIDUAL 

73700.0 

24 

1.606S-f05 

6693.17 

R-SOUARED 

0.5413 

RESID.  MEAN  SQUARE  (MSS)  3685 

.00 

ADJUSTED  R- SQUARED 

0.4494 

STANDARD 

DEVIATICB) 

60.7042 

aNNIZOBTED  LEAST  SQOAItU  LZHIAR  KBORUSZaN  OF  SCBBDPU  (MODEL  14) 


f 


V 


PREDICTOR 

VARIABLES  COEFFICIENT  STD  ERROR  STODENT'S  T  P  VIF 


CtBISTAMT 

77.4450 

36.4773  2.12 

0.0464 

NOECPS 

1.84081 

0.57715  3.19 

0.0046 

1.1 

PLPRSSCH 

-94.9353 

31.1949  -3.04 

0.0064 

1.0 

PLTRM 

-39.3033 

24.7509  -1.59 

0.1280 

1.0 

TDEFM 

63.9000 

26.3344  2.43 

0.0248 

1.1 

R- SQUARED 

0.5306 

RESID.  MEAN  SQUARE 

(MSS)  3770.02 

ADJUSTED  R- 

SQUARED  0.4367 

STANDARD  DEVIATICBI 

61.4005 

SOURCS 

DF  SS 

MS  F 

P 

REGRESSICH 

RESIDUAL 

TOTAL 

4  85235.6 
20  75400.5 
24  1.606B+05 

31308.9  5.65 

3770.02 

0.0033 

STEPWISE  ANALYSIS  OF  VARIANCE  OF  SCHEDPER 


SOURCE 

INDIVIDUAL  CUM 

SS  DF 

CUMULATIVE 

SS 

CUMULATIVE 

NS 

ADJUSTED 

R-SQUARED 

MALLOWS' 

CP 

P 

CONSTANT 

1.2S3B'f05 

NOECPS 

24869.9  1 

34869.9 

24869.9 

0.1181 

15.0 

2 

PLPRSSCH 

30179.5  2 

55049.5 

27524.7 

0.2829 

9.0 

3 

PLTRM 

7988.94  3 

63038.4 

21012.8 

0.3056 

8.9 

4 

TDEFM 

23197.1  4 

85235.6 

21308.9 

0.4367 

5.0 

5 

RESIDUAL 

75400.5  24 

1.606E'»0S 

6693.17 

R- SQUARED 

0.5306 

RESID.  MEAN  SQUARE  (MSS)  3770 

.02 

ADJUSTED  R-SQUARED  0.4367 

STANDARD 

DEVIATICBI 

61.4005 

M-7 


onaxiaimu  liast  ggoAUs  unjjt  iMusazm  or  scuDm  (moosl  is) 

PMOZCTOR 


VARIABLES 

COEFFICIENT 

STD  ERROR 

STUDENT'S 

T  P 

VIF 

COHSTANT 

S8.0736 

35.7945 

1.90 

0.0717 

NOBCPS 

1.S3350 

0.58513 

2.77 

0.0117 

1.1 

PLPRBSCH 

-113. 4S0 

32.7051 

-3.47 

0.0024 

1.1 

PLACHR 

47.130S 

30.S915 

1.54 

0.1404 

1.1 

TDBFN 

S4.2S93 

26.4493 

2.43 

0.0246 

1.1 

R-saOAREO 

0.5372 

RESID.  MEAN  SQUARE 

(M8E)  3797.75 

ADJUSTED  R-SVIARED  0.432S 

STANDARD 

DEVIATZOH 

61.6259 

SOURCE 

DF  SS 

NS 

r 

P 

RBCatESSION 

4  84S81.0 

21170.2 

5.57 

0.0035 

RESIDUAL 

20  759SS.1 

3797.75 

TOTAL 

24  l.SOSE+OS 

STBPMZSB  ANALYSIS  OF  VARZAMCB  OF  SCHBDFBR 


SOURCE 

IMDZVZDOAL  COM 
SS  OP 

CUMULATIVE 

SS 

CUMULATIVE 

NS 

ADJUSTED 

R-SQOARED 

MALLOWS' 

CP 

P 

CONSTJUn 

l.lSSE-fOS 

NOECPS 

34869.9  1 

34869.9 

24869.9 

0.1181 

14.7 

2 

PLPRESCH 

30179.5  2 

55049.5 

27524.7 

0.2829 

8.8 

3 

PLAOCm 

7193.96  3 

62243.5 

20747.8 

0.3000 

8.9 

4 

TDEFH 

22437.5  4 

84681.0 

21170.2 

0.4336 

5.0 

5 

RESIDUAL 

75955.1  24 

1.606B>05 

6693.17 

R- SQUARED 

0.5272 

RESID.  MEAN  SQUARE  (MSE)  3797. 

.75 

» 

ADJUSTED 

R-SQUARED  0.4326 

STANDARD 

DEVIATION 

61.6259 

ammzancD  least  squaabs  lznbab  bboussxc«  or  schbdfbe  (model  is) 

PREDICTOR 


VARIABLES 

COEFFICIENT 

STD  ERROR 

STUDENT' S 

T  P 

VIF 

CONSTANT 

81.9740 

37.4602 

2.19 

0.0407 

NOBCPS 

2. 

10534 

0.61833 

3.40 

0.0028 

1.3 

PLPRBSCH 

-98 

.1257 

31.2392 

-3.14 

0.0051 

1.0 

OCOSTCD 

-0. 

00285 

0.00186 

-1.53 

0.1417 

1.2 

TDEFM 

59 

.2691 

26.4431 

2.24 

0.0365 

1.1 

R-SQUARED 

0.5268 

RESID. 

MEAN  SQUARE 

(MSE)  3800.45 

ADJUSTED  R-SQOARED 

0.4332 

STANDARD  DEVIATICHI 

61.6478 

SOURCE 

OF 

SS 

NS 

F 

P 

REGRBSSIOI 

4 

84627.1 

21156.7  5.57 

0.0035 

RESIDUAL 

20 

76009.0 

3800. 

45 

, 

TOTAL 

34 

1.606B+0S 

STEPWISE  ANALYSIS  OF  VARIANCE  OF  SCHEDPBR 


SOURCE 

INDIVIDUAL 

SS 

CUM 

DF 

COMOLATIVB 

SS 

CDMULATIVB 

MS 

ADJUSTED 

R-SQUARED 

MALLOWS' 

CP 

P 

CONSTANT 

1.352B4.0S 

NOBCPS 

34869.9 

1 

24869.9 

34869.9 

0.1181 

14.7 

2 

PLPRBSCH 

30179.5 

2 

55049.5 

27524.7 

0.3839 

8.8 

3 

OCOSTCD 

10484.8 

3 

65534.3 

31844.7 

0.3234 

8.0 

4 

TDEFM 

19092.7 

4 

84627.1 

31156.7 

0.4322 

5.0 

5 

RESIDUAL 

76009.0 

24 

1.606B>05 

6693.17 

R-SQDARBD 

0.5368 

RESID.  MEAN  SQUARE  (MSB)  3800 

.45 

ADJUSTED  R 

[-SQUARED  0. 

.4322 

STANDARD 

DEVIATI(»( 

61.6478 

M-e 


tMoxoRiD  UMT  SQimu  bznMt  iMuasioH  or  scamn  (naon.  17) 


ntIDZCTOR 

VMUABUts  coirrzczBrr  std  sititoR  sroDarr's  t  p 


VIF 


V 


4 


CSMSTART 

186.049 

48.3731 

3.85 

0.0010 

MOKPS 

1.34336 

0.59930 

3.07 

0.0513 

1.3 

PLPRB8CH 

-74.3064 

31.7850 

-3.33 

0.0301 

1.0 

PtMDIV 

-64.4836 

30.1301 

-3.14 

0.0449 

1.1 

PUffiRTP 

-53.7983 

33.1175 

-1.59 

0.1366 

1.1 

R-SQORItlD  0.51C4  RISZO.  MUM  SQOAU  (MSI)  38S3.92 

AOJDSRD  R-SQOMUD  0.4197  STRMDRRD  OIVZATIOH  63.3311 


SOURCE 

DP 

SS 

MS 

P 

P 

KaasMssioK  * 

83957.6 

30739.4 

5.34 

0.0043 

RBSIOOAL 

30 

77678.5 

3883.93 

TOTAL 

34  1. 

.6061+05 

STBPHISI 

ANALYSIS  OP 

VARIAHd 

OP  SCKIDPKR 

IMDIYZOUAL 

CUN 

CDMOLATm 

CDMOLATIVS 

ADJOSTBD 

MALLOWS 

SOORCI 

SS 

DP 

SS 

MS 

R-SQUARED 

CP 

CONSTAMT 

1.353l-f05 

MOBCPS 

34869.9 

1 

34869.9 

34869.9 

0.1181 

14.0 

PLPRESCH 

30179.5 

3 

55049.5 

37534 . 7 

0.3839 

8.3 

PLNDIV 

18036.3 

3 

73085.8 

34361.9 

0.3771 

5.5 

PLDRRFP 

9871.74 

4 

83957.6 

30739.4 

0.4197 

5.0 

RBSZOUAL 

77678.5 

34 

1. 6068+05 

6693.17 

R-SQCnRID  0.5164  RISID.  MIAN  SQCARH  (MSS)  3883.93 

ADJUSTSD  R-SQOMIBD  0.4197  STANDARD  DBVZATZON  63.3311 


V 


M-9 


tManoRD  iMMWt  waattUM  i.tmm  nmtMxm  or  ■ohmk*)  (hoobl  d 


9MDXCTQII 

COIFPZCZIMT 

STO  BWOR 

STDDBIT'S 

T  P 

VZF 

coaMTRitr 

32.2592 

11.4743 

2.81 

0.0111 

imcps 

1.72735 

0.17187 

10^05 

0.0000 

1.2 

PLPRISCa 

-50.' 

7126 

9.53248 

-5.32 

0.0000 

1.0 

PLCOMC 

25.3720 

8.04702 

3.15 

0.0052 

1.2 

R-SgOBUUtD 

0.8748 

RISZD.  MIMf  SQORRI 

(MSI)  298. 

.993 

RDJOSTID  R-SOORRID 

0.8550 

STRMDMtO  DSVZATZOH 

17.2914 

SOORCI 

DP 

SS 

MS 

P 

P 

RIORISSZOH 

3 

39691.6 

13230.5 

44.25 

0.0000 

RISZOORL 

19 

5680.88 

298.993 

TOIRL 

22 

45372.5 

STIPNISI  AMRLYSIS  OF  VMUMiCI  OP  SCBIDIKX) 

ZMDZVIOaM.  COM 

OMJLRTZVS 

CONOZATZVI  RDJUSTID 

MKLLOHS' 

SODRd 

SS 

OP 

SS 

MS 

R-SQORRID 

CP 

CXMSTMIT 

59741.4 

NOICFS 

27555.7  1 

27555.7 

27555.7 

0.5886 

40.6 

PLPRISCH 

9163.49  2 

36719.2 

18359.6 

0.7902 

11.9 

PLCOMC 

2972.38  3 

39691.6 

13230.5 

0.8550 

4.0 

RISIDORL 

5680.88  22 

45372.5 

2062.38 

R-SOOMUtO  0.8748 

ADJUSTRD  R-SQORRBD  0.8SS0 


RXSZO.  MBM  SQORRB  (MSI)  298. »»3 
STAMDMtO  OlVXATICH  17.2914 


aMMIXORID  URST  SOOUUU  T.THM  UOISMZOII  OT  SOBSMOO  (MOOn.  2) 


PRIDZCTOR 

VRRZABLIS 

COIPPZCZINT 

STO  IRROR 

STODBIT’S 

T  P 

VZP 

coHSTJurr 

41.2717 

10.6109 

3.89 

0.0010 

MOICPS 

1.65160 

0.16886 

9.78 

0.0000 

1.1 

PLPRISCH 

-60.3720 

10.1487 

-5.95 

0.0000 

1.1 

TDIFM 

23.3299 

8.08765 

2.88 

0.0095 

1.2 

R-SQOARID 

0.8674 

RISZD.  MIAM  SQOARS 

(MSI)  316 

.724 

ADJDSTID  R-SQtARID 

0.8464 

STAMDARO  OIVIATZCH 

17.7967 

SOORCI 

DP 

SS 

MS 

P 

P 

RKBtlSSZON 

3 

39354.7 

13118.2 

41.42 

0.0000 

RISZDOAL 

19 

6017.76 

316.724 

TOTJkL 

22 

45372.5 

STIPNZSI  AHALYSZS  OP  VARZAMCI  OP  SCHIDMU) 

ZMDZVZDOAL 

COM 

COMOliATZVI 

CDMOLATZVI  ADJDSTID 

MALLOHS' 

SOORCI 

SS 

DP 

SS 

MS 

CP 

COMSTAMT 

59741.4 

IK»CPS 

27555.7 

1 

27555.7 

27555.7 

0.5886 

37.3 

PLPRISCH 

9163.49 

2 

36719.2 

18359.6 

0.7902 

10.3 

TDIPM 

2635.50 

3 

39354.7 

13118.2 

0.8464 

4.0 

RISZDOAL 

6017.76 

22 

45372.5 

2062.38 

% 


R-SOORRXD  0.8S74 

ADJOSTD  R-SQaASB)  0.8464 


RISZD.  NUN  SOOMtl  (MSI)  316.724 
STMIBMU)  DIVZRTZON  17.7967 


/ 


M-10 


VUDXCTCR 


VARXAKJtS 

COSPPXCXSWT 

STD  SRROR 

STODSMT'S  T 

P 

VIP 

COMSTAMT 

11.9336 

21.7009 

0.55 

0.5999 

HCaCPS 

1.55050 

0 . 17494 

9.97 

0.0000 

1.0 

PLPRBSCH 

-43.9709 

11.5547 

-3.71 

0.0015 

1.2 

Hopmxos 

4.00545 

1.90539 

3.10 

0.0491 

1.3 

R-SQOMUD  0.M53  KI8ZO.  MIMI  SOCOUIB  (MSI)  3C9.49S 

ADJOSTID  R-«]QMtlD  0.9209  STRMDRRD  DRVXATIOII  19.2333 

800RCI  or  SR  NS  r  P 


RRORtSSIOH  3  393S2.1  13794.0  34. CO  0.0000 

RUZDORL  19  7030.40  349. 49S 

TOT3U.  32  4S372.S 

STIPWZSR  MIM.YSZS  OP  VRRZMICR  OP  SCRIDHQD 

IMDZVZOIIRL  CON  COMOULTZVI  CDMOLRTIVS  ADOOSTRO  NAIXONS 
SOORCB  SS  DP  SS  MS  R-SQOARRD  CP 

OCHSTANT  S9741.4 
NOICPS  37SS5.7  1  27SSS.7  37S5S.7  O.SSSC  29.2  3 

PLPR18CH  9163.49  3  36719.2  19359.6  0.7903  6.4  3 

NOPMDIOS  1633.95  3  39353.1  13794.0  0.9209  4.0  4 

RRSIOOAL  7020.40  33  45372.5  2063.39 

R-SQOARSD  0.9453  RtSZO.  MEAN  SQOARS  (MSS)  369.495 

ADJOSTSD  R-SQOARSD  0.9209  STANDARD  DSVZATZOH  19.2223 


UMMSlMtSD  bSAST  SQOASSS  IiTMSAR  RBOSSSSXOM  OP  SOBDIiaO  (mOSX.  4) 

PRSDXCm 


VARXARLSS 

COSPPXCXSNT  STD  SRROR 

STODSMT'S 

T  P 

VIP 

COHSTAMT 

23 

.6741 

17.4979 

1.30 

0.2103 

HOSCPS 

1. 

60436 

0.19045 

9.99 

0.0000 

1.1 

PLPRSSCH 

-53.3236 

10.5946 

-5.04 

0.0001 

1.0 

H(X>XDS 

0. 

42793 

0.20405 

2.10 

0.0496 

1.1 

R-SQOARSD 

0.9451 

RBSXD.  NBAN  SQOARS 

(MSB)  369.865 

ADJOSTSD  R-SQOARSD 

0.9207 

STANDARD 

OBVIATION 

19.2318 

SOORCS 

DP 

SS 

MS 

F 

P 

RBGBOUSXCM 

3 

30345.0 

13791.6 

34.56 

0.0000 

RSSXDOAL 

19 

7027.43 

369.965 

TOTAL 

22 

45373.5 

STSPNXSS  ANALYSXS  OP  VARXAMCS  OP  SCHBDMOD 


IMDXVXDOAL  COM  CDMDLATXVS  CniDLATXVS  ADJOSTSD  NAIXONS' 


SOORCB 

SS 

DP 

SS 

MS 

R-SQOARSD 

CP 

CONSTANT 

59741.4 

NOBCPS 

27555.7 

1 

27555.7 

27555.7 

0.5896 

29.3 

PLPRBSCH 

9163.49 

3 

36719.3 

19359.6 

0.7902 

6.4 

NOOIDS 

1625.83 

3 

38345.0 

12791.6 

0.9207 

4.0 

RBSIDOAL 

7027.43 

32 

45373.5 

2062.39 

R-SQOARSD 

0.8451 

RSSID.  NBAN  SQOARB  (MSB)  369.865 

ADJOSTSD  R- 

■SQOARBD 

0.8307 

STANDARD  DEVIATION 

19.2319 

izoa  or 


vnozcToii 


VAETAMJM 

COBPPICIBNT 

STD  ERROR 

STUDENT'S 

T  P 

VIP 

COUTANT 

44.CS34 

11.7771 

3.79 

0.0012 

■OKPS 

1.59899 

0.18717 

8.54 

0 . 0000 

1.1 

RUMESCH 

-55.3879 

10.9934 

-5.04 

0.0001 

1.0 

CTTRE 

15.8001 

8.98443 

1.78 

0.0941 

1.1 

R-8QOA1IBD 

0.83C1 

RESZD.  MEAN  SQUARE 

(MSB)  391.434 

ADJUSTED  R-SQUARED  0.8102 

STANDARD  1 

DBVIATIOM 

19.7847 

SOURCE 

DP  SB 

MS 

P 

P 

REQRBSSlCai 

3  37935.2 

12645.0 

32.30 

0.0000 

RESZIXOU. 

19  7437.25 

391.434 

TOTAL 

22  45372.5 

STEPWISE  ANALYSIS  OP  VARIANCE  OP  SCBEOMOO 

ZHDIVZOOAL  COM 

CUMULATIVE 

CUMULATIVE  ADJUSTED  MALLOWS' 

SOURCE 

SS  DP 

SS 

MS 

R-SQUARED 

CP 

P 

COinTAHT 

59741.4 

NOECPS 

27555.7  1 

27555.7 

27555.7 

0.5886  26.5 

2 

PLPRESCR 

91S3.49  2 

36719.2 

18359.6 

0.7902 

5.1 

3 

CTYPE 

121S.00  3 

37935.2 

12645.0 

0.8102 

4.0 

4 

RESIDUAL 

7437.25  22 

45372.5 

2062.38 

R-SQOARBD 

0.83S1 

RBSIO.  MEAN  SQUARE 

(MSB)  391.434 

ADJUSTED  R-SQUARED  0.8102 

STANDARD  OBVIATION 

19.7847 

UMWElOSaED 

tiBAST  tQQOUUUI  IMMtSiZOS  Of  fCBiBMOD  (tfOPfT-  C) 

PREDICTOR 

VARIABLES 

COBPPICIBNT 

STD  ERROR 

STUDENT'S 

T  P 

VIP 

CCHSTANT 

42.1821 

12.5313 

3.37 

0.0032 

NOECPS 

1.5718C 

0.18499 

8.50 

0.0000 

1.1 

PLPRESCR 

-51.5428 

10.9909 

-4.69 

0.0002 

1.0 

SOWCSSR 

14.389C 

8.86136 

1.66 

0.1131 

1.1 

R-SQUARED 

0.8335 

RBSID.  MEAN  SQUARE 

(MSB)  397.666 

ADJUSTED  R-SQUARED  0.8072 

STANDARD  DEVIATION 

19.9415 

SOURCE 

DP  SS 

MS 

P 

P 

REGRESSION 

3  37818.8 

12805.6 

31.70 

0.0000 

RESIDUAL 

19  7555.88 

397.666 

TOTAL 

22  45372.5 

STEPWISE  ANALYSIS  OP  VARIANCE  OP  SCHESMOO 

INDIVIDUAL  CUM 

CUMULATIVB 

CDNULATTVB  ADJUSTED  MALLOWS' 

SOURCE 

SS  DP 

SS 

MS 

R-SQUARED 

CP 

P 

CONSTANT 

59741.4 

NOECPS 

27555.7  1 

27555.7 

27555.7 

0.5886  25.8 

2 

PLPRESCR 

9183.49  2 

38719.2 

18359.6 

0.7902 

4.8 

3 

SOWCSSR 

1097.80  3 

37818.8 

12605.6 

0.8072 

4.0 

4 

RESIDUAL 

7555.86  22 

45372.5 

2062.38 

R-SQOMIID 
ADJUSTED  R-SOUARB) 


0.833S 
0 . 8072 


RBSZD.  MBAir  SQUARE  (USE) 
STANDARD  OBVZATZOH 


397. CCS 
19.9415 
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LBAST  SQOkBBB  L 

TIMAS  SBOSaS 

STflM  ns  SnVBRMWk 

(MOBBL  7) 

VZP 

PRXDZCTOR 

VARZABLBS 

CMGPPZCZBNT 

STD  BRROR 

STODBVT'S  T 

P 

COMSTAMT 

3S.0((4 

15.23(1 

2.50 

0.0314 

MOBCPS 

1.49207 

0. 1(3(4 

(.12 

0.0000 

1.0 

PLPRBSCH 

-52.3754 

11.2251 

-4.(7 

0.0003 

1.0 

PPSON 

0.32733 

0.244(0 

1.34 

0 . 19(4 

1.0 

A  R-SQOMtlD  O.aas?  MflZD.  NIMI  SQOMtl  (MSB)  41C.20S 

APJUSTBD  X-SaiflUtBD  0.7Ma  STMDMU)  OBVIATICW  20.4011 

sooBCB  or  ss  MS  r  p 

UCRBSSZOH  3  374(4.5  124SS.1  30.00  0.0000 

RBSZOaSL  19  7907.91  41(.20( 

TOTAL  22  45372.5 

STBPWZSI  AKALYSZS  OP  VARZAMCB  OP  SGHBMOO 

ZMDZVZDOAL  COM  CDMOLATZVI  COHOLATZVB  ADJOSTBD  MALLONS' 


SOORCB 

SS 

OP 

SS 

MS 

R-SOaARBD 

CP 

P 

COMSTAMT 

59741.4 

MOBCPS 

37555.7 

1 

27555.7 

27555.7 

0.50(6 

23.8 

2 

PLPRBSCH 

91(3.49 

2 

3(719.2 

1(359.6 

0.7902 

3.8 

3 

PPSOH 

745.353 

3 

374(4.5 

124((.l 

0.79(2 

4.0 

4 

RBSZDDAL 

7907.91 

32 

45372.5 

2063. 36 

R-SQOARBD 

0.(257 

RBSZO.  NBAM  SOOARB  (MSB)  416. 20S 

ADjnSTBD  R-SaOARBD 

0.79(2 

STAMDARO  DBVZATZOH 

20.4011 

amniicMtTEu  lbast  sQaAsas  lthbas  skibssszom  cm  sobomqo  oiodbl  s) 

PRBDZCTOR 

VARZABLBS  .  COEPPZCZBMT  STD  BSIUIIl  STODSKT'S  T  P  VZP 


COMSTAMT 

30.9033 

10.8393 

3.(5 

0.0106 

MOBCPS 

1.76449 

0.16333 

10.(1 

0.0000 

1.2 

PLPRBSCH 

-56.3005 

9.4(397 

-5.94 

0.0000 

1.1 

PLCONC 

18.3318 

8.49360 

2.16 

0.0447 

1.5 

TDBFM 

15.2707 

8.29413 

1.84 

0.0821 

1.5 

R-SQOARBD 

0.8946 

RBSZD.  MBAN 

SQOARB 

(MSB)  265.587 

ADJUSTBD  R- 

'SQOARBO  0.8712 

STAMDARD  DBVZATZCM 

16.2968 

SOORCB 

DP  SS 

MS 

P 

P 

RBCaiBSSZOR 

4  40591.9 

10147.9 

38.21 

0.0000 

RBSZDDAL 

18  4780.57 

265.587 

TOTAL 

23  45372.5 

STBPWZSB  AMALYSZS  OP  VARZAMCB  OP  SCKBOHCH) 


SOORCB 

ZMDZVZDOAL 

SS 

COM 

DP 

COHOLATZVB 

SS 

COMOLATIVB 

MS 

ADJOSTBD 

R-SQOARBD 

MALLOWS' 

CP 

P 

COMSTAMT 

59741.4 

MOBCPS 

27555.7 

1 

27555.7 

27555.7 

0.5886 

48.1 

2 

PLPRBSCH 

9163.49 

2 

36719.2 

1(359.6 

0.7902 

15.6 

3 

PLCOMC 

2972.38 

3 

39691.6 

13330.5 

0.8550 

6.4 

4 

TDBPM 

900.304 

4 

40591.9 

10147.9 

0.8712 

s.o 

5 

RBSZDDAL 

4780.57 

22 

45373.5 

2062.38 

R-SQOARBD 

0. 

.8946 

RBSZD.  MBAM  SQOARB  (MSB)  265 

.587 

ADJOSTBD 

R-SQOARBD  0. 

.8712 

STAMDARO 

DBVZATZ(» 

16.2968 
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mnxagRio  limt  sodsuou  ltmim  nouuiszoa  or  Bcmmao  (mokl  9) 
nUOTTIOR 


VARIABLBS 

COBPPICI8HT 

STD  BRRON 

STODBHT'S 

T  P 

VIP 

CONSTANT 

20 

.3845 

14.0742 

1.45 

0.1647 

HOBCPS 

1. 

78890 

0.17348 

10.31 

0 . 0000 

1.3 

PLPRBSCH 

-49 

.34SC 

9.35631 

-5.27 

0.0001 

1.0 

PLCOHC 

27 

.0197 

7.94334 

3.40 

0.0032 

1.3 

NDBVCSIT 

2. 

06593 

1.48280 

1.39 

0.1805 

1.1 

R-SQOARBD 

0.8870 

RBSIO.  NBAN  SQOARB 

(NSB)  284.881 

ADODSTBO  R-SQOARBD 

0.8619 

STANDARD  1 

OBVIATION 

16.8784 

SOORCB 

OP 

SS 

NS 

P 

P 

RBORBSSION 

4 

40244.6 

10061.1 

35.32 

0.0000 

RBSIOOAL 

IS 

5127.87 

284.881 

TOTAL 

22 

45372.5 

snpwxsi  ANALYSIS  OP  VARIANCB  OP  SCHBENOO 


SODRCB 

INDIVIDUAL 

SS 

COM 

DP 

COHDLATIVB 

SS 

COMOLATIVB 

MS 

ADJOSTBD 

R-SQOARBD 

MALLOHS' 

CP 

P 

CONSTANT 

59741.4 

NOBCPS 

27555.7 

1 

27555.7 

27555.7 

0.5886 

43.5 

2 

PLPRBSCH 

9163.49 

2 

36719.2 

18359.6 

0.7902 

13.4 

3 

PLCONC 

2972.38 

3 

39691.6 

13230.5 

0.8SS0 

4.9 

4 

NOBVCRIT 

553.009 

4 

40244.6 

10061.1 

0.8619 

S.O 

S 

RBSIDOAL 

5127.87 

22 

45372.5 

2062.38 

R-SQOARBO 

0 

.8870 

RBSID.  MBAN  SQOARB  <NSB)  284 

.881 

ADJOSTBD  R 

-SQOARBD  0 

.8619 

STANDARD 

OBVIATION 

16.1 

8784 

ommxmtMD  liast  sqoauu  lznbae  ttaussioN  or  schbdiiod  (modbl  10) 

PRBOICTOR 


VARIABLBS 

COBPPICIBNT 

STD  ERR(Hl 

STUDENT'S 

T  P 

VIP 

CONSTANT 

36.2792 

10.5406 

3.44 

0.0029 

NOBCPS 

1.72554 

0.16686 

10.34 

0.0000 

1.2 

PLPRBSCH 

-62.1091 

9.73493 

-6.38 

0.0000 

1.1 

CTYPB 

13.1536 

7,75011 

1.70 

0.1069 

1.1 

TDBPM 

21.7175 

7,77314 

2.79 

0.0120 

1.2 

R-SQOARBD 

0.8857 

RBSID.  MEAN  SQOARB 

(MSB)  288.199 

adjusted  R- 

SQOARBD  0.8603 

STANDARD 

OBVIATION 

16.9764 

SOORCB 

DP  SS 

MS 

P 

P 

RBCBtBSSION 

4  40184.9 

10046.2 

34.86 

0.0000 

RBSIDOAL 

18  5187.58 

288.199 

TOTAL 

22  45372.5 

STBPNZSB  ANALYSIS  OP  VARIANCB  OP  SCHBDMOD 


SOORCB 

INDIVIDUAL  COM 
SS  DP 

COMOLATIVB 

SS 

CUMOLATIVB 

NS 

ADJUSTED 

R-SQOARBD 

MALLONS’ 

CP 

P 

CONSTANT 

59741.4 

NOBCPS 

27555.7  1 

27555.7 

27555.7 

0.5886 

42.8 

2 

PLPRBSCH 

9163.49  2 

36719.2 

18359.6 

0.7902 

13.0 

3 

CTYPB 

1216.00  3 

37935.2 

12645.0 

0.8102 

10.8 

4 

TDBPM 

2249.67  4 

40184.9 

10046.2 

0.8603 

5.0 

S 

RBSIDOAL 

5187.58  22 

45372.5 

2062.38 

R-SQOARBD 

0.8857 

RBSID.  MBAN  SQOARB  (NSB)  288 

.199 

ADJUSTED  R-SQUARBD  0.8603 

STANDARD 

DBVIATICRi 

16.9764 

M-14 


t 


f 


tmmzaRiu  lust  sqouss  luius  uautssxo*  or  schidmod  (muml  id 

raiDZCTOR 


VARZABLBS 

C»BPPICIBNT 

STD  BRROR 

STODBNT'S 

T  P 

VI F 

CONSTANT 

33.6683 

11.0802 

3.04 

0.0071 

MOBCPS 

1.70879 

0.16467 

10.38 

0.0000 

1.2 

PLPRBSCH 

-59.0174 

9.71892 

-6.07 

0.0000 

1.1 

TDBPM 

22.1763 

7.74884 

2.86 

0.0104 

1.2 

S0NCS8R 

12.5235 

7.40596 

1.69 

0.1081 

1.1 

R-SQOARBD 

0.8856 

RBSIO.  MBAN  SQ0AR8 

(MSB)  288.489 

ADJUSTBD  R-SQOARBD  0.8601 

STANDARD  ! 

OBVIATION 

16.9849 

SOORCB 

DP  SS 

MS 

P 

P 

RBORBSSZON 

RBSZIRIAL 

TOTAL 

4  40179.6 
18  5192.81 
22  45372.5 

10044.9 

288.489 

34.82 

0.0000 

STBPNISB  AULYSIS  OP  VARIANCB  OP  SCHBOMOD 


INDIVIDOAL 
SOORCB  SS 

COM 

DP 

COMOLATIVE 

SS 

CUMULATIVE 

MS 

ADJUSTBD 

R-SQOARBD 

MALLOWS' 

CP 

P 

CONSTANT 

59741.4 

MOBCPS 

27555.7 

1 

27555.7 

27555.7 

0.5886 

42.8 

2 

PLPRBSCH 

9163.49 

2 

36719.2 

18359.6 

0.7902 

13.0 

3 

TDBPM 

2635.50 

3 

39354.7 

13118.2 

0.8464 

5.9 

4 

SOMCSSR 

824.943 

4 

40179.6 

10044.9 

0.8601 

5.0 

5 

RBSIDOAL 

5192.81 

22 

45372.5 

2062.38 

R-SQOARBD 

0. 

.8856 

RBSID.  MEAN  SQOARB  (MSB)  288. 

489 

ADJUSTBD  R-SQOARBO  0 

.8601 

STANDARD 

DBVIATKRI 

16.9849 

OmiBZaHrBD  LBMT  SQUBBS  LZMBBB  BBaBBSSZOM  OP  SCBBOHOD  (MODBL  12) 
PRBDICTOR 


VARIABLES 

COBFFICIBNT 

STD  ERROR 

STUDENT'S 

T  P 

VIP 

CONSTANT 

27.6095 

11.8297 

2.33 

0.0314 

MOBCPS 

1.75782 

0.17049 

10.31 

0.0000 

1.2 

PLPRBSCH 

-50.1227 

9.37678 

-5.35 

0.0000 

1.0 

PLCONC 

23.1394 

8.09147 

2.86 

0.0104 

1.3 

SONCSSR 

9.79555 

7.55179 

1.30 

0.2110 

1.1 

R-SQOARBD 

0.8855 

RBSID.  MBAN  SQUARE 

(MSB)  288. 

.625 

ADJUSTED  R- 

■SQUARED  1 

0.8601 

STANDARD  OBVIATICBI 

16.9889 

SOORCB 

DP 

SS 

MS 

P 

P 

RBCBtBSSION 

4 

40177.2 

10044.3 

34.80 

0.0000 

RBSIDOAL 

18 

5195.26 

288.625 

TOTAL 

22 

45372.5 

STBPHZSB  ANALYSIS  OP 

VARIANCB  OP  SCHBOMOD 

INDIVIDOAL 

COM 

COMOLATIVB 

COMOLATIVE  ADJUSTED 

MALLOWS' 

SOORCB 

SS 

DP 

SS 

MS 

R-S(30ARBD 

CP 

P 

CCNSTAMT 

59741.4 

MOBCPS 

27555.7 

1 

27555.7 

27555.7 

0.5886 

42.7 

2 

PLPRBSCH 

9163.49 

2 

36719.2 

18359.6 

0.7902 

13.0 

3 

PLCCRIC 

2972.38 

3 

39691.6 

13230.5 

0.8550 

4.7 

4 

SONCSSR 

485.616 

4 

40177.2 

10044.3 

0.8601 

5.0 

5 

RBSIDOAL 

5195.26 

22 

45372.5 

2062.38 

R-SQOARBD  0.8855  RBSIO.  MBAN  SQOARB  (MSB)  288.625 

ADJUSTBD  R-SQDARED  0.8601  STANDARD  DBVIATI(»I  16.9889 
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BUKUfU  UMT  fgOUUM  LUnut  IMUSaZOM  or  SCBBMOO  (MODK.  13) 


PRIDICTOR 


VARIAB1.B8 

COBrriCIBNT 

STD  BRROR 

STODBNT'S  T 

P 

vir 

CONSTANT 

12.5163 

19.2151 

0.65 

0 

.5230 

NOBCPS 

1.72129 

0.16923 

10.17 

0 

.0000 

1.2 

PLTRBSCH 

-45.3786 

10.2795 

-4.41 

0 

.0003 

1.2 

PLCONC 

21.3232 

8.53788 

2.50 

0 

.0224 

1.4 

NOPMDIOS 

2.30949 

1.81854 

1.27 

0 

.2203 

1.4 

R-SOOARBD 

0.8851 

RBSID.  MBAN  SQOARB  (MSB) 

289. 

651 

AOJDSTBD  R' 

-SQOARBD 

0.8596 

STANDARD  OBVIATION 

17.0191 

SOORCB 

DP 

SS 

MS 

r 

p 

RBQRBSSIOH 

4 

40158.7 

10039.6 

34.66 

0.0000 

RBSIDOAL 

18 

5213.72 

289.651 

TOTAI. 

22 

45372.5 

STBPNISB  ANALYSIS  Or  VARIANCB  OF  SCHBDHOD 

INDIYIOQAL  COM 

CDMOLATIVB 

CDMOLATIVB 

AOJOSTBD 

MALtOHS' 

SOORCB 

SS 

OF 

SS 

MS 

R-SQDARBO 

CP 

P 

CONSTANT 

59741.4 

1 

NOBCPS 

27555.7  1 

27555.7 

27555.7 

0. 

5886 

42.5 

2 

PLPRBSCH 

9163.49  2 

36719.2 

18359.6 

0. 

7902 

12.9 

3 

PLCONC 

2972.38  3 

39691.6 

13230.5 

0. 

8550 

4.6 

4 

NOPMDIOS 

467.155  4 

40158.7 

10039.6 

0. 

8596 

5.0 

5 

RBSIDOAL 

5213.72  22 

45372.5 

2062.38 

R-SQOARBD 

0.8851 

RBSID.  MBAN  SQOARB  (MSB) 

289. 

651 

ADJUSTBD  R'SQOARBD 

0.8596 

STANDARD  OBVIATICM 

17.0191 

oiMuamD  uuun  saoutu  bzinu  uoibsbzom  or  schemod  (mon.  i4) 


PRBDICTOR 

VARIABLBS 

COBrriCIBNT 

STD  BRROR 

STUDBNT'S 

T 

P 

VIP 

CONSTANT 

14.4832 

19.2896 

0.75 

0.4625 

NOBCPS 

1.66677 

0.16215 

10.28 

0.0000 

1.1 

PLPRBSCH 

-52.2267 

10.9316 

-4.78 

0.0002 

1.4 

TDBFM 

19.8749 

8.03669 

2.47 

0.0236 

1.3 

NOPMDIDS 

2.86527 

1.75296 

1.63 

0.1195 

1.3 

R-SQDARBD  0.8845 

ADJUSTBD  R-SQUARBD  0.8588 

RBSID.  MBAN  SQUARB 
STANDARD  DBVIATION 

(MSB) 

291.111 

17.0619 

SODRCB 

DP 

SS 

NS 

P 

P 

RBORBSSKXI 

4 

40132.5 

10033.1 

34.46 

0.0000 

RBSIDOAL 

18 

5240.00 

291.111 

TOTAL 

22 

45372.5 

STBPNISB  ANALYSIS 

OP  V3UIIANCB  OP 

SCHBDNOD 

SOORCB 

INDIVIDOAL 

SS 

COM 

DP 

CQMUIATZVB 

SS 

CDMOLATIVB 

MS 

ADJUSTBD 

R- SQOARBD 

HALLONS' 

CP 

P 

CCNSTANT 

NOBCPS 

59741.4 

27555.7 

1 

27555.7 

27555.7 

0.5886 

42.2 

2 

PLPRBSCH 

9163.49 

2 

36719.2 

18359.6 

0.7902 

12.7 

3 

TDBPM 

2635.50 

3 

39354.7 

13118.2 

0.8464 

5.7 

4 

NOPMDIDS 

777.755 

4 

40132.5 

10033.1 

0.8588 

5.0 

5 

RBSIDOAL 

5240.00 

22 

45372.5 

2062.38 

R-SQOAItED  0.8845  RBSID.  HSAN  SQOMtS  (MSB)  291.111 

AOJUSTBD  R-SgOARBD  0.8588  STANDARD  OBVIATION  17.0619 
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